-- Logs begin at Tue 2022-08-09 10:40:08 UTC, end at Tue 2022-08-09 11:57:41 UTC. -- Aug 09 11:17:03.825258 dv-cinder-849890-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 11:17:03.834091 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 11:17:03 2022] *** Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: nodename: dv-cinder-849890-5-iscsi Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: machine: x86_64 Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: clock source: unix Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: pcre jit disabled Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: detected number of CPU cores: 4 Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: current working directory: / Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: detected binary path: /usr/bin/uwsgi-core Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: your processes number limit is 47680 Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: your memory page size is 4096 bytes Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: detected max file descriptor number: 2048 Aug 09 11:17:03.836119 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: lock engine: pthread robust mutexes Aug 09 11:17:03.836989 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: thunder lock: enabled Aug 09 11:17:03.836989 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 11:17:03.836989 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 11:17:03.875111 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: Python main interpreter initialized at 0x558b75a6d9c0 Aug 09 11:17:03.875111 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: python threads support enabled Aug 09 11:17:03.875111 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: your server socket listen backlog is limited to 100 connections Aug 09 11:17:03.875111 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: your mercy for graceful operations on workers is 90 seconds Aug 09 11:17:03.875627 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 11:17:03.875627 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: *** Operational MODE: preforking *** Aug 09 11:17:03.875855 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: *** uWSGI is running in multiple interpreter mode *** Aug 09 11:17:03.875855 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: spawned uWSGI master process (pid: 103078) Aug 09 11:17:03.876061 dv-cinder-849890-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 11:17:03.876669 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: spawned uWSGI worker 1 (pid: 103079, cores: 1) Aug 09 11:17:03.876983 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: spawned uWSGI worker 2 (pid: 103080, cores: 1) Aug 09 11:17:03.877187 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 11:17:04.533698 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 11:17:04.534310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 11:17:05.598754 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:17:05.598754 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: from cryptography.utils import int_from_bytes Aug 09 11:17:05.599400 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:17:05.599400 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: from cryptography.utils import int_from_bytes Aug 09 11:17:05.608814 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:17:05.608814 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: from cryptography.utils import int_from_bytes Aug 09 11:17:05.609323 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:17:05.609323 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: from cryptography.utils import int_from_bytes Aug 09 11:17:08.071182 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:17:08.071814 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:17:08.071963 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:17:08.072323 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:17:08.072579 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:17:08.072938 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.073286 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.073589 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:17:08.074005 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.074177 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:17:08.074250 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.074250 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.074379 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:17:08.074521 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.074738 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:17:08.074926 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.075027 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:17:08.075114 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.075389 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.075558 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.075694 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.075781 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.076021 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.076152 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.076336 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.076478 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-5-iscsi {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.076650 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.076810 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.076905 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.076995 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.077248 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.077378 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.077561 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.077691 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.077849 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.077942 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.078124 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.078234 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.078463 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.078568 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.078796 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-5-iscsi {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.078990 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.079418 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.079544 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.079655 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.079759 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.079859 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.080007 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.080128 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.080328 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.080518 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.080669 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.080751 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.080913 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.081001 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.081246 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.081470 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.081609 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.081746 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.081836 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.082063 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.082160 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.082371 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.082552 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-5-iscsi {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.082710 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.082889 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.083050 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.083190 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.083355 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.083506 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.083674 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.083918 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.084059 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.084226 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.084332 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.084528 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.084616 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.084828 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.084954 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-5-iscsi {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.085148 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.085268 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.085453 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.085578 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.085776 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.085891 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.086090 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.086304 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.086399 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.086615 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.086709 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.086946 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.087046 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.087267 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.087361 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.087587 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.087675 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.087902 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.087982 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.088204 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.088296 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.088509 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.088636 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.088756 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.088975 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.089091 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.089175 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.089364 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.089450 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.089681 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.089766 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.090001 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.090081 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.090249 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.090326 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.090498 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.090615 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.090849 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.090969 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.091156 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.091258 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.091458 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.091620 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.091756 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.091842 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.092070 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.092181 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.092364 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.092450 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.092621 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.092748 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.092873 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.093006 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.093172 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.093299 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.093491 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.093620 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.093825 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.094013 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.094168 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.094254 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.094471 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.094588 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.094778 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.094955 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.095119 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.095247 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.095423 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.095545 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.095726 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.095884 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.096131 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.096276 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.096397 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.096517 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.096648 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.096778 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.096951 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.097080 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.097368 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.097536 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.097655 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.097789 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.097907 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.098028 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.098139 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.098459 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.098564 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.098650 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.098751 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.099064 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.099251 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.099372 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.099487 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.099641 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.099733 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.099949 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.100088 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.100244 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.100533 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.100634 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.100705 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.100966 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.101187 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.101315 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.101448 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.101522 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.101758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.101828 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.102007 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.102192 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.102311 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.102439 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.102564 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.102689 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.102865 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.103017 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.103153 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.103270 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.103443 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.103629 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.103742 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.104052 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.104211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.104352 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.104480 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.104580 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.104670 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.104920 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.105084 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.105224 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.105358 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.105488 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.105615 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.105789 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.105922 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.106186 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.106293 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.106417 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.106508 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.106712 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.106852 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.106963 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.107204 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.107361 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.107510 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.107622 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.107814 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.107990 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.108161 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.108339 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.108482 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.108615 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.108702 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.108787 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.109039 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.109186 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.109287 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.109392 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.109673 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.109814 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.109996 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.110138 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.110278 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.110390 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.110605 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.110735 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.110924 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.111069 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.111207 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.111304 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.111528 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.111659 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.111809 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.111909 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.112117 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.112258 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.112404 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.112496 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.112697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.112788 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.112999 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.113089 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.113307 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.113404 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.113608 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.113711 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.113908 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.114005 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.114212 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.114308 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.114512 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.114614 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.114840 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.114931 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.115145 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.115595 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.115813 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.115913 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.116115 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.116209 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.116417 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.116506 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.116718 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.116818 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.117035 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.117125 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.117356 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.117453 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.117670 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.117760 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.117975 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.118064 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.118276 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.118365 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.118594 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:17:08.118691 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.118954 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.119118 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.119270 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.119359 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.119569 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.119669 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.119897 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.120010 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.120209 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.120304 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.120524 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.120610 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.120839 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.120925 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.121148 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.121248 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.121460 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.121565 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.121788 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.121921 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.122103 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.122199 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.122405 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.122491 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.122717 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.122874 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.123062 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.123168 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.123382 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.123475 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.123699 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.123785 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.124015 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.124109 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.124321 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.124406 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.124629 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.124714 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.124935 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.125033 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.125335 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.125426 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.125666 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.125751 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.125976 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.126069 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.126284 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.126375 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.126594 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.126693 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.126925 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.127026 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.127238 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.127333 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.127549 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.127641 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.127858 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.127953 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.128196 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.128289 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.128505 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.128589 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.128815 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.128907 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.129122 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.129247 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.129436 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.129522 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.129745 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.129831 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.130056 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.130155 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.130362 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.130462 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.130664 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.130750 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.130992 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.131082 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.131295 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.131394 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.131603 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.131688 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.131905 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.132034 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.132222 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.132323 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.132542 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.132626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.132841 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.132926 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.133159 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.133252 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.133461 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.133546 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.133770 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.133855 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.134076 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.134179 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.134376 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.134461 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.134677 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.134761 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.135010 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.135101 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.135319 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.135404 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.135620 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.135712 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.135937 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.136022 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.136246 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.136332 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.136552 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.136683 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.136873 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.136967 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.137177 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.137261 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.137476 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.137560 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.137788 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.137874 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.138096 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.138181 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.138400 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.138493 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.138707 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.138793 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.139042 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.139141 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.139366 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.139470 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.139676 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.139793 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.139986 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.140102 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.140318 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.140428 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.140645 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.140741 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.140977 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.141063 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.141285 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.141380 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.141602 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.141695 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.141914 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.141999 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.142215 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.142314 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.142521 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.142608 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.142846 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.142936 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.143149 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.143255 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.143450 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.143536 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.143759 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.143844 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.144060 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.144153 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.144363 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.144454 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.144663 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.144748 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.144964 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.145051 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.145265 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.145351 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.145582 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.145680 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.145889 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.145974 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.146188 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.146339 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.146487 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.146588 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.146788 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.146892 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.147115 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.147214 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.147432 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.147533 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.147739 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.147825 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.148045 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.148130 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.148349 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.148443 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.148652 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.148738 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.148956 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.149042 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.149279 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.149367 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.149589 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.149683 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.149892 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.149968 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.150196 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.150273 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.150507 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.150642 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.150831 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.150926 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.151153 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.151243 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.151472 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.151558 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.151782 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.151868 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.152110 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.152223 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.152416 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.152514 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.152730 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.152831 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.153029 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.153114 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.153343 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.153430 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.153653 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.153753 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.153965 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.154052 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.154277 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.154366 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.154596 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.154695 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.154923 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.155013 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.155236 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.155322 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.155544 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.155640 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.155853 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.155938 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.156161 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.156253 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.156528 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.156619 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.156852 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.156997 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.157158 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.157286 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.157472 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.157605 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.157779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.157913 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.158098 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.158229 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.158404 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.158534 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.158722 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.158878 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.159046 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.159179 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.159360 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.159491 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.159671 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.159817 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.159982 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.160114 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.160294 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.160421 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.160629 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.160763 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.160892 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.160988 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.161205 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.161332 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.161509 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.161635 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.161817 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.161958 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.162120 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.162251 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.162416 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.162556 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.162718 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.162873 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.163056 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.163143 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.163366 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.163463 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.163672 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.163771 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.163977 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.164064 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.164292 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.164378 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.164599 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.164686 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.164902 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.164988 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.165203 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.165289 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.165512 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.165598 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.165816 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.165907 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.166124 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.166210 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.166436 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.166522 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.166749 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.166866 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.167075 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.167167 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.167378 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.167466 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.167681 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.167765 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.167991 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.168090 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.168294 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.168380 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.168594 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.168678 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.168895 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.168993 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.169202 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.169288 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.169525 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.169648 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.169824 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.169919 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.170137 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.170224 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.170460 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.170563 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.170754 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.170916 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.171083 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.171171 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.171390 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.171475 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.171699 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.171787 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.172037 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.172152 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.172336 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.172466 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.172645 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.172758 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.172951 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.173039 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.173257 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.173344 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.173567 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.173664 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.173871 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.173957 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.174188 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.174274 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.174493 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.174580 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.174799 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.174929 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.175127 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.175223 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.175430 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.175515 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.175735 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.175821 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.176047 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.176151 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.176356 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.176629 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.176723 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.176957 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.177056 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.177266 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.177361 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.177574 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.177661 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.177888 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.177972 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.178194 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.178289 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.178504 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.178597 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.178839 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.178941 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.179137 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.179231 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.179446 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.179547 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.179758 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.179859 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.180060 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.180329 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.180425 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.180657 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.180742 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.180962 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.181056 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.181262 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.181355 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.181563 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.181649 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.181868 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.181962 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.182169 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.182253 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.182469 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.182562 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.182769 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.183023 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.183121 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.183212 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.183389 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.183475 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.183690 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.183775 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.183998 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.184085 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.184298 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.184383 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.184616 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.184702 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.184924 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.185011 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.185225 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.185310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.185526 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.185611 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.185826 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.185912 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.186126 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.186210 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.186429 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.186522 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.186741 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.186846 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.187084 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.187170 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.187391 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.187500 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.187754 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.187847 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.188061 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.188147 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.188381 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.188474 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.188682 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.188768 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.188983 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.189068 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.189283 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.189368 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.189587 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.189671 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.189887 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.189972 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.190189 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.190275 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.190495 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.190579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.190807 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.190922 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.191132 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.191226 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.191436 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.191521 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.191734 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.191818 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.192039 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.192142 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.192337 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.192423 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.192647 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.192765 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.192951 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.193048 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.193249 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.193335 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.193546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.193645 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.193849 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.193934 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.194152 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.194237 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.194450 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.194545 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.194758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.194862 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.195080 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.195164 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.195381 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.195480 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.195681 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.195774 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.195981 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.196065 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.196277 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.196362 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.196583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.196676 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.196885 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.196970 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.197183 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.197268 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.197496 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.197591 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.197800 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.197885 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.198101 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.198186 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.198399 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.198484 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.198700 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.198784 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.199027 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.199114 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.199330 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.199416 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.199631 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.199730 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.199935 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.200029 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.200244 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.200337 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.200546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.200640 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.200849 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.200933 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.201148 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.201233 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.201449 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.201548 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.201750 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.201836 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.202050 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.202134 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.202351 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.202444 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.202650 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.202792 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.203004 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.203109 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.203298 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.203385 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.203598 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.203684 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.203916 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.204003 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.204218 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.204303 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.204515 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.204599 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.204817 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.204910 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.205116 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.205273 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.205414 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.205500 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.205722 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.205815 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.206024 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.206121 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.206334 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.206420 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.206637 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.206731 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.206965 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.207053 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.207271 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.207356 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.207583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.207690 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.207886 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.207972 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.208182 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.208266 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.208484 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.208652 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.208788 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.208873 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.209092 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.209176 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.209391 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.209486 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.209690 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.209776 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.210004 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.210135 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.210314 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.210409 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.210619 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.210705 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.210960 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.211048 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.211277 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.211371 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.211588 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.211682 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.211886 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.211971 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.212192 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.212286 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.212499 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.212583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.212800 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.212885 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.213101 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.213186 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.213403 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.213488 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.213704 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.213788 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.214011 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.214097 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.214318 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.214411 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.214625 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.214720 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.214963 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.215052 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.215260 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.215346 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.215564 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.215662 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.215870 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.215955 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.216175 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.216267 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.216481 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.216574 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.216785 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.216878 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.217086 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.217170 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.217393 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.217487 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.217692 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.217787 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.217996 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.218084 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.218296 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.218382 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.218602 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.218730 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.218994 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.219163 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.219310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.219473 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.219622 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.219776 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.219930 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.220080 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.220257 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.220391 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.220570 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.220702 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.220874 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.221013 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.221184 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.221313 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.221488 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.221724 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.221816 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.222031 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.222124 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.222338 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.222506 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.222646 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.222844 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.222977 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.223149 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.223277 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.223456 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.223584 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.223763 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.223906 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.224071 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.224209 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.224386 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.224508 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.224701 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.224801 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.225004 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.225112 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.225411 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.225496 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.225719 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.225805 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.226030 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.226123 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.226346 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.226431 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.226649 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.226743 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.226992 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.227134 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.227303 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.227446 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.227628 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.227818 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.227933 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.228063 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.228236 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.228379 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.228538 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.228701 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.228859 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.229002 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.229162 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.229312 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.229479 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.229619 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.229893 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.229979 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.230206 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.230344 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.230509 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.230596 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.230905 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.231145 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.231246 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.231334 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.231473 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.231572 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.231790 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.231875 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.232098 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.232193 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.232416 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.232509 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.232764 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.232849 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.233076 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.233165 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.233388 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.233491 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.233712 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.233798 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.234034 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.234119 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.234337 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.234433 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.234677 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.234771 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.235008 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.235115 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.235308 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.235393 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.235610 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.235697 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.235927 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.236013 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.236229 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.236316 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.236533 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.236651 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.236839 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.236977 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.237144 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.237289 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.237443 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.237612 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.237741 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.237944 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.238042 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.238249 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.238336 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.238554 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.238640 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.238898 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.238989 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.239211 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.239308 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.239519 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.239607 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.239842 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.239930 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.240495 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.240631 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.240812 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.240897 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.241114 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.241201 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.241414 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.241505 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.241715 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.241817 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.242017 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.242102 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.242338 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.242424 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.242644 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.242738 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.242993 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.243121 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.243321 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.243439 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.243628 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.243723 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.243953 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.244040 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.244276 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.244362 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.244584 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.244679 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.244899 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.244993 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.245220 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.245357 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.245519 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.245707 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.245848 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.246017 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.246112 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.246363 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.246462 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.246670 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.246758 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.247008 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.247102 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.247313 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.247422 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.247615 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.247702 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.247914 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.248015 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.248215 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.248381 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.248531 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.248607 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.248836 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.248930 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.249153 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.249239 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.249457 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.249542 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.249757 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.249843 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.250087 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.250261 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.250427 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.250513 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.250739 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.250844 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.251073 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.251161 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.251380 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.251466 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.251690 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.251775 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.251995 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.252082 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.252298 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.252392 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.252601 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.252695 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.252911 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.252995 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.253213 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.253306 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.253524 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.253618 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.253832 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.253918 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.254138 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.254231 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.254442 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.254535 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.254744 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.254907 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.255079 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.255165 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.255396 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.255495 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.255731 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.255967 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.256052 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.256293 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.256388 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.256605 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.256692 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.256917 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.257002 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.257228 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.257324 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.257541 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.257636 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.257851 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.257945 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.258161 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.258268 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.258472 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.258579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.258779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.258932 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.259110 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.259197 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.259423 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.259508 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.259743 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.259829 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.260063 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.260303 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.260395 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.260632 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.260734 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.260948 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.261042 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.261264 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.261350 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.261577 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.261663 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.261893 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.261986 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.262206 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.262291 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.262520 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.262614 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.262892 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.263200 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.263200 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.263430 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.263514 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.263667 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.263770 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.263855 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.264051 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.264147 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.264359 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.264490 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.264670 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.264767 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.264978 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.265064 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.265284 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.265384 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.265594 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.265720 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.265940 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.266028 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.266265 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.266360 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.266597 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.266685 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.266923 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.267012 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.267239 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.267327 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.267547 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.267640 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.267856 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.267950 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.268169 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.268396 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.268496 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.268716 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.268814 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.269048 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.269134 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.269371 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.269456 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.269684 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.269770 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.269997 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.270084 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271004 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271124 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271217 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271299 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271299 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271456 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271537 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271616 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271695 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271774 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271858 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.271926 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.272138 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.272289 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.272458 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.272718 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.272805 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.273034 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.273129 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.273364 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.273461 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.273677 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.273855 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.273996 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.274211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.274298 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.274562 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.274663 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.274899 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.274988 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.275223 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.275310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.275544 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.275640 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.275853 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.275944 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.276156 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.276249 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.276467 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.276560 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.276770 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.276862 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.277075 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.277161 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.277381 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.277468 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.277690 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.277775 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.278177 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.278280 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.278521 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.278612 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.278710 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.278894 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.279002 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.279205 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.279292 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.279511 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.279611 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.279813 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.279902 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.280136 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.280230 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.280437 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.280524 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.280744 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.280842 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.281046 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.281133 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.281410 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.281506 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.281737 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.281859 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.282051 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.282145 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.282352 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.282444 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.282654 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.282760 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.282987 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.283075 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.283288 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.283387 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.283596 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.283720 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.283896 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.284019 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.284196 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.284294 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.284493 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.284591 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.284800 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.284896 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.285100 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.285194 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.285406 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.285499 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.285711 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.285799 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.286015 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.286137 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.286333 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.286437 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.286636 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.286723 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.286964 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.287055 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.287278 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.287365 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.287591 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.287742 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.287943 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.288262 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.288355 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.288819 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.288919 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.289237 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.289384 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.289472 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.291200 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.291550 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.292521 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.292612 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.292708 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.292799 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.292891 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293024 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293109 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293178 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293251 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293251 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293410 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293540 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293628 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293709 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293797 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293887 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.293969 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294087 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294173 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294241 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294315 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294409 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294490 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294587 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294669 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294756 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294756 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.294946 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.295027 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.295106 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.295185 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.295263 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.295354 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.295435 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.295514 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.295714 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.295801 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.296026 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.296144 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.296339 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.296464 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.296647 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.296781 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.297081 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.297198 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.297328 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.297415 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.297642 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.297727 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.297955 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.298042 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.298271 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.298377 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.298584 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.298673 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.298919 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.299008 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.299234 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.299331 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.299547 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.299640 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.299851 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.299991 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.300159 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.300275 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.300472 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.300590 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.300783 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.300907 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.301093 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.301225 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.301405 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.301533 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.301721 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.301850 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.302063 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.302171 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.302383 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.302479 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.302702 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.302791 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.303046 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.303145 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.303364 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.303451 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.303675 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.303768 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.303984 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.304070 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.304294 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.304389 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.304604 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.304691 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.304919 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.305020 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.305236 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.305336 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.305544 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.305640 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.305845 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.305939 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.306157 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.306275 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.306461 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.306562 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.306758 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.306962 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.307091 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.307217 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.307398 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.307681 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.307766 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.307845 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.307986 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.308142 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.308292 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.308452 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.308594 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.308771 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.308894 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.309083 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.309195 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.309410 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.309510 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.309749 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.309837 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.310068 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.310162 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.310368 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.310477 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.310676 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.310762 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.310999 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.311100 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.311300 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.311397 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.311604 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.311694 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.311907 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.311994 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.312206 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.312293 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.312509 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.312725 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.312869 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.312961 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.313188 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.313277 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.313517 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.313614 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.313800 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.313889 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.314105 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.314193 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.314411 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.314510 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.314725 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.315050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.315181 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.315272 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.315354 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.315435 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.315666 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.315813 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.315944 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.316052 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.316281 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.316437 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.316593 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.316699 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.316878 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.317011 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.317182 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.317327 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.317464 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.317575 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.317756 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.317869 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.318061 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.318174 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.318365 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.318475 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.318673 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.318775 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.319017 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.319113 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.319330 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.319419 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.319647 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.319734 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.319961 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.320047 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.320269 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.320360 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.320577 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.320662 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.320892 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.320984 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.321248 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.321343 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.321506 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.321608 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.321814 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.321919 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.322116 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.322202 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.322429 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.322523 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.322754 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.322995 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.323091 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.323176 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.323386 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.323479 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.323700 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.323853 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.324019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.324111 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.324343 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.324435 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.324649 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.324750 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.324969 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.325061 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.325289 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.325380 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.325602 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.325694 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.325921 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.326012 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.326243 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.326349 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.326554 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.326692 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.326894 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.326988 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.327205 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.327298 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.327503 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.327597 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.327745 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:17:08.327854 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.328103 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.328439 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.328753 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.329066 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.329373 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.329675 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.329990 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.330335 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.330649 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.330975 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.331303 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.331624 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.331972 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.332287 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.332630 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.332956 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.333272 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.333584 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.333890 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:17:08.334134 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:17:08.485533 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO dbcounter [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Registered counter for database nova_api Aug 09 11:17:08.491507 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO dbcounter [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Registered counter for database nova_api Aug 09 11:17:08.507958 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_db.sqlalchemy.engines [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:08.511682 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:08.514733 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writer thread running {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:08.518414 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writer thread running {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:08.571184 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.context [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4705de16-1b33-4787-8512-7dde2b8ef61e(cell1) {{(pid=103080) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 11:17:08.575332 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.context [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4705de16-1b33-4787-8512-7dde2b8ef61e(cell1) {{(pid=103079) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 11:17:08.575558 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:17:08.575829 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:17:08.577438 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:17:08.578263 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:17:08.578749 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:17:08.579431 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_concurrency.lockutils [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:17:08.579922 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_concurrency.lockutils [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:17:08.580870 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:17:08.581540 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_concurrency.lockutils [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:17:08.582326 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_concurrency.lockutils [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:17:08.582776 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_concurrency.lockutils [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:17:08.583032 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO dbcounter [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Registered counter for database nova_cell0 Aug 09 11:17:08.584900 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_concurrency.lockutils [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:17:08.587101 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO dbcounter [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Registered counter for database nova_cell0 Aug 09 11:17:08.589157 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO dbcounter [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Registered counter for database nova_cell1 Aug 09 11:17:08.593269 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO dbcounter [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Registered counter for database nova_cell1 Aug 09 11:17:08.597200 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_db.sqlalchemy.engines [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:08.600112 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_db.sqlalchemy.engines [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:08.601198 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:08.602576 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:08.605161 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writer thread running {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:08.609699 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writer thread running {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:08.611261 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writer thread running {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:08.742335 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writer thread running {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:08.752530 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO dbcounter [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Registered counter for database nova_cell0 Aug 09 11:17:08.761916 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_db.sqlalchemy.engines [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:08.763011 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO dbcounter [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Registered counter for database nova_cell0 Aug 09 11:17:08.767541 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writer thread running {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:08.772654 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:17:08.777668 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writer thread running {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:17:09.101192 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: WARNING keystonemiddleware.auth_token [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:17:09.108453 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: WARNING keystonemiddleware.auth_token [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:17:09.109930 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: WARNING keystonemiddleware.auth_token [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:17:09.117588 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: WARNING keystonemiddleware.auth_token [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:17:09.449001 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: WARNING keystonemiddleware.auth_token [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:17:09.455097 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: WARNING keystonemiddleware.auth_token [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:17:09.460118 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: WARNING keystonemiddleware.auth_token [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:17:09.460368 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b75a6d9c0 pid: 103080 (default app) Aug 09 11:17:09.462423 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:17:09.463632 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Aug 09 11:17:09.464042 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Tue Aug 9 11:17:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:17:09.466120 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: WARNING keystonemiddleware.auth_token [None req-bd5f25fb-b799-4d64-a79e-77a801a1d8de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:17:09.471515 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558b75a6d9c0 pid: 103079 (default app) Aug 09 11:18:26.692893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:26.693892 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 09 11:18:26.694544 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:26.710804 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writing DB stats nova_api:SELECT=3 {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:26.711749 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writing DB stats nova_cell0:SELECT=3 {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:26.712449 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writing DB stats nova_cell1:SELECT=3 {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:26.713561 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:27.562326 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-c087c907-a4e9-4cd0-9943-5f38ae04df6b admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:27.594886 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-c087c907-a4e9-4cd0-9943-5f38ae04df6b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893004 Aug 09 11:18:27.595833 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 9 11:18:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:29.845958 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:29.847172 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-78ea2879-8e0a-45bf-8c02-78c459cd6f4e None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 09 11:18:29.847811 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:30.325247 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-3decc276-b588-4f2e-a677-2e5475d27999 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256"}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:30.345651 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:18:30.345651 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: warnings.warn(msg) Aug 09 11:18:30.375686 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-3decc276-b588-4f2e-a677-2e5475d27999 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.521340 Aug 09 11:18:30.376433 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:18:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:18:30.392061 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_api:SELECT=3 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:30.393656 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_cell1:SELECT=3 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:30.394381 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_cell0:SELECT=3 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:30.395132 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:30.608301 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-a0c78642-d53f-451d-85d0-da9285ae4f0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:30.613047 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:18:30.613047 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: warnings.warn(msg) Aug 09 11:18:30.680892 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-a0c78642-d53f-451d-85d0-da9285ae4f0c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295533 Aug 09 11:18:30.690856 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 11:18:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:32.994501 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-3decc276-b588-4f2e-a677-2e5475d27999 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:32.995650 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-3decc276-b588-4f2e-a677-2e5475d27999 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Aug 09 11:18:32.996157 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:33.679492 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-5c0df5de-50a5-4aeb-a1ec-f342ce555418 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:33.699308 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:18:33.699308 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: warnings.warn(msg) Aug 09 11:18:33.720510 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-5c0df5de-50a5-4aeb-a1ec-f342ce555418 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.717724 Aug 09 11:18:33.721404 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:18:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 11:18:33.733887 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-d897b632-9ff3-46c2-b08a-704c8ccc6553 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:33.736814 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:18:33.736814 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: warnings.warn(msg) Aug 09 11:18:33.773807 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-d897b632-9ff3-46c2-b08a-704c8ccc6553 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043563 Aug 09 11:18:33.774402 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 11:18:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:35.995268 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-5c0df5de-50a5-4aeb-a1ec-f342ce555418 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:35.996525 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-5c0df5de-50a5-4aeb-a1ec-f342ce555418 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 09 11:18:35.999195 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:35 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:36.434466 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-78bfb1f0-c59b-4dbf-b0b2-92d9b72c2fe7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "vcpus": 1, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:36.453622 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-78bfb1f0-c59b-4dbf-b0b2-92d9b72c2fe7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450934 Aug 09 11:18:36.454166 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:18:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:18:36.466479 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-b67b5a5b-870d-420d-a1e5-5516b2348486 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:36.497288 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-b67b5a5b-870d-420d-a1e5-5516b2348486 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034630 Aug 09 11:18:36.497991 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 11:18:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:38.664525 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-78bfb1f0-c59b-4dbf-b0b2-92d9b72c2fe7 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:38.666500 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-78bfb1f0-c59b-4dbf-b0b2-92d9b72c2fe7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002316 Aug 09 11:18:38.666920 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:39.118122 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-21523d4a-8def-4bb2-a6e3-178f5fe172a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3"}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:39.147468 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-21523d4a-8def-4bb2-a6e3-178f5fe172a9 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473195 Aug 09 11:18:39.147660 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:18:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:18:39.161516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-29592308-370d-4881-b019-bdf571c6f19a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:39.186394 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-29592308-370d-4881-b019-bdf571c6f19a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029832 Aug 09 11:18:39.187002 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 11:18:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:41.445827 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-21523d4a-8def-4bb2-a6e3-178f5fe172a9 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:41.446746 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-21523d4a-8def-4bb2-a6e3-178f5fe172a9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 09 11:18:41.447490 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:41.921742 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-70978a58-d6ad-48a6-b1e3-b268ae7f920b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:41.942349 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-70978a58-d6ad-48a6-b1e3-b268ae7f920b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488446 Aug 09 11:18:41.943228 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:18:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 11:18:41.955958 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-4da6c0c0-f2d8-4488-9cd4-e038aa6fa315 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:41.983375 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-4da6c0c0-f2d8-4488-9cd4-e038aa6fa315 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031322 Aug 09 11:18:41.983967 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 11:18:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:44.292993 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-70978a58-d6ad-48a6-b1e3-b268ae7f920b admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:44.294096 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-70978a58-d6ad-48a6-b1e3-b268ae7f920b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Aug 09 11:18:44.294525 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:44.824472 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-f48050e7-35e4-4ba7-ba3f-54bf17a6bc46 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:44.854055 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-f48050e7-35e4-4ba7-ba3f-54bf17a6bc46 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.550384 Aug 09 11:18:44.854682 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 9 11:18:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:18:47.158611 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-70978a58-d6ad-48a6-b1e3-b268ae7f920b admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:47.159709 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-70978a58-d6ad-48a6-b1e3-b268ae7f920b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 09 11:18:47.160127 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:47.741887 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-50e7aaab-9793-4695-a8ab-07985da73270 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "id": "1"}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:47.769778 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-50e7aaab-9793-4695-a8ab-07985da73270 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.601422 Aug 09 11:18:47.770982 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:18:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:18:47.790651 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-eb08292a-d7d8-4d3a-9eb8-86a36045e93c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:47.827620 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-eb08292a-d7d8-4d3a-9eb8-86a36045e93c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046944 Aug 09 11:18:47.828234 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 11:18:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:50.126423 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-50e7aaab-9793-4695-a8ab-07985da73270 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:50.128220 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-50e7aaab-9793-4695-a8ab-07985da73270 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002547 Aug 09 11:18:50.128901 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:50.696783 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-b194c5c2-4ad7-497c-988d-7e6d4611ab73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "disk": 20}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:50.724198 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-b194c5c2-4ad7-497c-988d-7e6d4611ab73 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.587702 Aug 09 11:18:50.725095 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:18:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 11:18:50.745272 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-10862a9c-37af-493a-9c34-c4fab744c8e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:50.784064 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-10862a9c-37af-493a-9c34-c4fab744c8e8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045073 Aug 09 11:18:50.785075 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 11:18:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:53.655225 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-b194c5c2-4ad7-497c-988d-7e6d4611ab73 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:53.656676 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-b194c5c2-4ad7-497c-988d-7e6d4611ab73 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Aug 09 11:18:53.657221 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:54.158055 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-a71e4044-1abc-46d3-b75b-3a354812326e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "ram": 4096}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:54.187113 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-a71e4044-1abc-46d3-b75b-3a354812326e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.522546 Aug 09 11:18:54.187812 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:18:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:18:54.200201 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-ead4a14d-99af-41c0-b4c5-d51d5089bd6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:54.227757 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-ead4a14d-99af-41c0-b4c5-d51d5089bd6d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031368 Aug 09 11:18:54.228429 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 11:18:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:18:56.615752 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-a71e4044-1abc-46d3-b75b-3a354812326e admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:18:56.617442 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-a71e4044-1abc-46d3-b75b-3a354812326e admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Aug 09 11:18:56.617854 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:18:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:18:57.447005 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-f34179f1-0e0f-4b44-a943-6455319dd070 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:57.464510 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:57.493736 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-f34179f1-0e0f-4b44-a943-6455319dd070 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.864558 Aug 09 11:18:57.507641 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:18:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:18:57.515255 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-19bef6d4-0501-4563-87e6-97d60a828be5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:18:57.560281 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-19bef6d4-0501-4563-87e6-97d60a828be5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049963 Aug 09 11:18:57.561677 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 11:18:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:19:00.014608 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-f34179f1-0e0f-4b44-a943-6455319dd070 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:00.015720 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-f34179f1-0e0f-4b44-a943-6455319dd070 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Aug 09 11:19:00.016155 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:00.571828 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-4a0ea823-dfd0-4352-8e16-c7896bacf7f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "id": "5", "ram": 16384}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:00.604363 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-4a0ea823-dfd0-4352-8e16-c7896bacf7f3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.580884 Aug 09 11:19:00.606862 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 11:19:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 11:19:00.639738 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-de57ebaa-b817-4416-8bf9-e139e6f4c3b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:00.697827 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-de57ebaa-b817-4416-8bf9-e139e6f4c3b1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076757 Aug 09 11:19:00.706889 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 11:19:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:19:22.286951 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-4a0ea823-dfd0-4352-8e16-c7896bacf7f3 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:22.288021 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-4a0ea823-dfd0-4352-8e16-c7896bacf7f3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Aug 09 11:19:22.288509 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:22.300707 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:22.785403 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-0b7c7b35-67df-4438-aec8-36d82606e4a2 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:22.805628 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-0b7c7b35-67df-4438-aec8-36d82606e4a2 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.509453 Aug 09 11:19:22.806223 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 9 11:19:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:24.088664 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-4a0ea823-dfd0-4352-8e16-c7896bacf7f3 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:24.089749 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-4a0ea823-dfd0-4352-8e16-c7896bacf7f3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 09 11:19:24.090158 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:19:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:19:24.760195 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-7c97fdf6-fdcd-4ff2-92fb-9a1dd0198293 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:24.766873 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.wsgi [None req-7c97fdf6-fdcd-4ff2-92fb-9a1dd0198293 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-7c97fdf6-fdcd-4ff2-92fb-9a1dd0198293 admin admin] Request method failure captured: Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Accept: application/json Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Accept-Encoding: gzip, deflate Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Connection: keep-alive Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Content-Length: 0 Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Host: 10.222.0.59 Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Openstack-Api-Version: compute 2.90 Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Openstack-System-Scope: None Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: User-Agent: python-novaclient Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Auth-Token: gAAAAABi8kK7EFvUrCa7UekTUO-Q1Yaw3uiyfvonrF38-Dan2zppb2WjKwfM3bzAi3NajzmyUM7sy_OSnzOiY-nxnlR81fB_ByaxuAE7bJgT3dQDx15N6V5l_GyGFxdWF3FfN4AabyQNjyoXObm7ZyW7sjRoV1OvqL_NUXJjMCRtoju7eTuwIOg Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Domain-Id: None Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Domain-Name: None Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Identity-Status: Confirmed Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Is-Admin-Project: True Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Domain-Id: default Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Domain-Name: Default Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Name: admin Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Role: admin,reader,member Aug 09 11:19:24.770308 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Roles: admin,reader,member Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3f8f671817444c358cd7614c06a172b5", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Tenant: admin Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Tenant-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Tenant-Name: admin Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User: admin Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Domain-Id: default Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Domain-Name: Default Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Id: b49c0d97d3434e41bf484d267b0b8e0e Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Name: admin Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: method: > Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: exception: Flavor 42 could not be found. Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: action_args: {'id': '42'} Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:24.772861 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:24.774483 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.776465 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-7c97fdf6-fdcd-4ff2-92fb-9a1dd0198293 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:24.778521 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-7c97fdf6-fdcd-4ff2-92fb-9a1dd0198293 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.538951 Aug 09 11:19:24.778521 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Aug 9 11:19:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:24.786119 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-9102b959-8255-476f-b931-e2eeb05c6303 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:24.793535 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:24.832152 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-9102b959-8255-476f-b931-e2eeb05c6303 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.052538 Aug 09 11:19:24.833138 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 11:19:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:24.844645 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-969f9675-ea02-4e81-a188-5f7310b81c22 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:24.871459 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-969f9675-ea02-4e81-a188-5f7310b81c22 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031028 Aug 09 11:19:24.872038 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 11:19:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:24.883086 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-c8af4194-6004-4d9c-be78-4fc65a0f856e admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:24.890026 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.wsgi [None req-c8af4194-6004-4d9c-be78-4fc65a0f856e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-c8af4194-6004-4d9c-be78-4fc65a0f856e admin admin] Request method failure captured: Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Accept: application/json Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Accept-Encoding: gzip, deflate Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Connection: keep-alive Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Content-Length: 0 Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Host: 10.222.0.59 Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Openstack-Api-Version: compute 2.90 Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Openstack-System-Scope: None Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: User-Agent: python-novaclient Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Auth-Token: gAAAAABi8kK7EFvUrCa7UekTUO-Q1Yaw3uiyfvonrF38-Dan2zppb2WjKwfM3bzAi3NajzmyUM7sy_OSnzOiY-nxnlR81fB_ByaxuAE7bJgT3dQDx15N6V5l_GyGFxdWF3FfN4AabyQNjyoXObm7ZyW7sjRoV1OvqL_NUXJjMCRtoju7eTuwIOg Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Domain-Id: None Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Domain-Name: None Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Identity-Status: Confirmed Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Is-Admin-Project: True Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Domain-Id: default Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Domain-Name: Default Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Name: admin Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Role: admin,reader,member Aug 09 11:19:24.893546 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Roles: admin,reader,member Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3f8f671817444c358cd7614c06a172b5", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Tenant: admin Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Tenant-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Tenant-Name: admin Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User: admin Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Domain-Id: default Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Domain-Name: Default Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Id: b49c0d97d3434e41bf484d267b0b8e0e Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Name: admin Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: method: > Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: exception: Flavor 42 could not be found. Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: action_args: {'id': '42'} Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:24.896050 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:24.897626 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:24.899779 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-c8af4194-6004-4d9c-be78-4fc65a0f856e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:24.901641 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-c8af4194-6004-4d9c-be78-4fc65a0f856e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016375 Aug 09 11:19:24.901641 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Aug 9 11:19:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:25.972836 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-969f9675-ea02-4e81-a188-5f7310b81c22 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:25.973942 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-969f9675-ea02-4e81-a188-5f7310b81c22 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 09 11:19:25.974318 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:19:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:26.599795 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-14b40109-0455-46e5-a4c9-2a1165c49a2b admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:26.605946 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.wsgi [None req-14b40109-0455-46e5-a4c9-2a1165c49a2b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-14b40109-0455-46e5-a4c9-2a1165c49a2b admin admin] Request method failure captured: Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Accept: application/json Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Accept-Encoding: gzip, deflate Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Connection: keep-alive Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Content-Length: 0 Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Host: 10.222.0.59 Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Openstack-Api-Version: compute 2.90 Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Openstack-System-Scope: None Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: User-Agent: python-novaclient Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Auth-Token: gAAAAABi8kK9IFdNNmIoMa2OB7wTUjYb8B1jlPTR1co4UzzTK2cUk2RHvrCUSnnDv9IQOqcq7GUfRqFrn765zFgz6CnHBMJsDvSwSka6AGdmeMFvy4AwnH3X-JCw1tjrQyTxHc2v44bDjJOBM88qKhagwgJuxQHN-GAokLRPzSVjbi2bjQ7Ka68 Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Domain-Id: None Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Domain-Name: None Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Identity-Status: Confirmed Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Is-Admin-Project: True Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Domain-Id: default Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Domain-Name: Default Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Name: admin Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Role: admin,reader,member Aug 09 11:19:26.608083 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Roles: admin,reader,member Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3f8f671817444c358cd7614c06a172b5", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Tenant: admin Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Tenant-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Tenant-Name: admin Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User: admin Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Domain-Id: default Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Domain-Name: Default Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Id: b49c0d97d3434e41bf484d267b0b8e0e Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Name: admin Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: method: > Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: exception: Flavor 84 could not be found. Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: action_args: {'id': '84'} Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:26.612211 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:26.613667 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.615893 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-14b40109-0455-46e5-a4c9-2a1165c49a2b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:26.617904 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-14b40109-0455-46e5-a4c9-2a1165c49a2b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.493132 Aug 09 11:19:26.617904 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Aug 9 11:19:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 494 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:26.620683 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-b5f39f1d-5b67-4d91-b225-db27d0e89ae8 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:26.637187 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-b5f39f1d-5b67-4d91-b225-db27d0e89ae8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020172 Aug 09 11:19:26.637791 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 11:19:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:26.648874 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-f15fe9ef-7409-467b-a53b-95a93d7bcbb3 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:26.665725 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-f15fe9ef-7409-467b-a53b-95a93d7bcbb3 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020804 Aug 09 11:19:26.666330 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 11:19:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:26.676983 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-2c2a5f18-0dcb-4de9-8d90-7bfa16a514b4 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:26.683268 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.wsgi [None req-2c2a5f18-0dcb-4de9-8d90-7bfa16a514b4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-2c2a5f18-0dcb-4de9-8d90-7bfa16a514b4 admin admin] Request method failure captured: Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Accept: application/json Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Accept-Encoding: gzip, deflate Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Connection: keep-alive Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Content-Length: 0 Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Host: 10.222.0.59 Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Openstack-Api-Version: compute 2.90 Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Openstack-System-Scope: None Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: User-Agent: python-novaclient Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Auth-Token: gAAAAABi8kK9IFdNNmIoMa2OB7wTUjYb8B1jlPTR1co4UzzTK2cUk2RHvrCUSnnDv9IQOqcq7GUfRqFrn765zFgz6CnHBMJsDvSwSka6AGdmeMFvy4AwnH3X-JCw1tjrQyTxHc2v44bDjJOBM88qKhagwgJuxQHN-GAokLRPzSVjbi2bjQ7Ka68 Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Domain-Id: None Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Domain-Name: None Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Identity-Status: Confirmed Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Is-Admin-Project: True Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Domain-Id: default Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Domain-Name: Default Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Name: admin Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Role: admin,reader,member Aug 09 11:19:26.684989 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Roles: admin,reader,member Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3f8f671817444c358cd7614c06a172b5", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Tenant: admin Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Tenant-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Tenant-Name: admin Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User: admin Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Domain-Id: default Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Domain-Name: Default Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Id: b49c0d97d3434e41bf484d267b0b8e0e Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Name: admin Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: method: > Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: exception: Flavor 84 could not be found. Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: action_args: {'id': '84'} Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:26.686516 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:26.687579 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:26.689041 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-2c2a5f18-0dcb-4de9-8d90-7bfa16a514b4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:26.690343 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-2c2a5f18-0dcb-4de9-8d90-7bfa16a514b4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013345 Aug 09 11:19:26.690343 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Aug 9 11:19:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:27.767471 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-f15fe9ef-7409-467b-a53b-95a93d7bcbb3 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:27.768534 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-f15fe9ef-7409-467b-a53b-95a93d7bcbb3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Aug 09 11:19:27.768993 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:19:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:28.461003 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-16aa45d5-aa42-42a8-84c6-b0ff324ad26a admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:28.467722 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.wsgi [None req-16aa45d5-aa42-42a8-84c6-b0ff324ad26a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-16aa45d5-aa42-42a8-84c6-b0ff324ad26a admin admin] Request method failure captured: Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Accept: application/json Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Accept-Encoding: gzip, deflate Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Connection: keep-alive Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Content-Length: 0 Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Host: 10.222.0.59 Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Openstack-Api-Version: compute 2.90 Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Openstack-System-Scope: None Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: User-Agent: python-novaclient Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Auth-Token: gAAAAABi8kK_gq1tQaFqyAq64g5l9lKlrVpS891vBQoeYBjtuxBPWGNkEdg1QwXLvIUX3ja_ovEzcFANkejlZm4fj6QdZUfJ4TduSWl5SqfivkPmv2a8533WYT7NvplYO3bQysD_PhMMa6Xv0-wbbtvhMieH4hVKr2flUHN3fYRwOiox12JuHbQ Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Domain-Id: None Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Domain-Name: None Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Identity-Status: Confirmed Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Is-Admin-Project: True Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Domain-Id: default Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Domain-Name: Default Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Project-Name: admin Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Role: admin,reader,member Aug 09 11:19:28.469310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Roles: admin,reader,member Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3f8f671817444c358cd7614c06a172b5", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Tenant: admin Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Tenant-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-Tenant-Name: admin Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User: admin Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Domain-Id: default Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Domain-Name: Default Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Id: b49c0d97d3434e41bf484d267b0b8e0e Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: X-User-Name: admin Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: method: > Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: exception: Flavor 451 could not be found. Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: action_args: {'id': '451'} Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:28.471802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:28.472758 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.474246 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-16aa45d5-aa42-42a8-84c6-b0ff324ad26a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:28.475845 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-16aa45d5-aa42-42a8-84c6-b0ff324ad26a admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.564491 Aug 09 11:19:28.475845 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 11:19:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 566 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:28.481536 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-fad33a13-4263-496b-aa87-c79a2deb1e98 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:28.498161 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-fad33a13-4263-496b-aa87-c79a2deb1e98 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020272 Aug 09 11:19:28.498780 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 11:19:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:28.513001 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:28.543789 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.037302 Aug 09 11:19:28.544751 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 11:19:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:19:28.555632 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-3f333053-ec2c-48cf-93c2-5a61663722fb admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:28.563802 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.wsgi [None req-3f333053-ec2c-48cf-93c2-5a61663722fb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-3f333053-ec2c-48cf-93c2-5a61663722fb admin admin] Request method failure captured: Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Accept: application/json Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Accept-Encoding: gzip, deflate Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Connection: keep-alive Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Content-Length: 0 Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Host: 10.222.0.59 Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Openstack-Api-Version: compute 2.90 Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Openstack-System-Scope: None Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: User-Agent: python-novaclient Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Auth-Token: gAAAAABi8kK_gq1tQaFqyAq64g5l9lKlrVpS891vBQoeYBjtuxBPWGNkEdg1QwXLvIUX3ja_ovEzcFANkejlZm4fj6QdZUfJ4TduSWl5SqfivkPmv2a8533WYT7NvplYO3bQysD_PhMMa6Xv0-wbbtvhMieH4hVKr2flUHN3fYRwOiox12JuHbQ Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Domain-Id: None Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Domain-Name: None Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Identity-Status: Confirmed Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Is-Admin-Project: True Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Domain-Id: default Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Domain-Name: Default Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Project-Name: admin Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Role: admin,reader,member Aug 09 11:19:28.566019 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Roles: admin,reader,member Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3f8f671817444c358cd7614c06a172b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3f8f671817444c358cd7614c06a172b5", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Tenant: admin Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Tenant-Id: 3f8f671817444c358cd7614c06a172b5 Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-Tenant-Name: admin Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User: admin Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Domain-Id: default Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Domain-Name: Default Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Id: b49c0d97d3434e41bf484d267b0b8e0e Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: X-User-Name: admin Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: method: > Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: exception: Flavor 451 could not be found. Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: action_args: {'id': '451'} Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:19:28.567697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:28.568583 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: ERROR nova.api.openstack.wsgi Aug 09 11:19:28.569714 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-3f333053-ec2c-48cf-93c2-5a61663722fb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:19:28.571181 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-3f333053-ec2c-48cf-93c2-5a61663722fb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.016611 Aug 09 11:19:28.571181 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 11:19:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:29.720506 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:29.721840 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Aug 09 11:19:29.722278 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:19:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:30.377697 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-335abfcb-2f33-4830-a885-3f029263f8a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:30.399381 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-335abfcb-2f33-4830-a885-3f029263f8a0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.529662 Aug 09 11:19:30.399977 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Aug 9 11:19:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:19:31.556157 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:31.557104 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 09 11:19:31.557639 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:19:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:32.251917 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-03fcb4a0-8242-4be1-bd83-85627f96ece7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:32.277514 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-03fcb4a0-8242-4be1-bd83-85627f96ece7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.572536 Aug 09 11:19:32.278333 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Aug 9 11:19:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:19:33.413649 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:33.414769 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Aug 09 11:19:33.415208 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:34.135412 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-78e3b677-0731-44da-a04a-e9b952be2e01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:34.158796 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-78e3b677-0731-44da-a04a-e9b952be2e01 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.606951 Aug 09 11:19:34.159455 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Aug 9 11:19:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:19:35.236200 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:35.237779 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002367 Aug 09 11:19:35.238300 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:35.851168 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-175a82aa-cfad-454a-a8b1-764d19dd02a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:19:35.872908 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-175a82aa-cfad-454a-a8b1-764d19dd02a7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.493654 Aug 09 11:19:35.873504 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Aug 9 11:19:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:19:36.973802 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:36.974894 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Aug 09 11:19:36.975310 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:19:37.580568 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-dec1f307-2259-4797-8aca-a1f15faf7ee0 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:19:37.603180 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-dec1f307-2259-4797-8aca-a1f15faf7ee0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.489644 Aug 09 11:19:37.603787 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Tue Aug 9 11:19:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:20:34.534652 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:34.535709 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-11e943f8-87d0-46b7-b01e-d9ef2bbc334c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 09 11:20:34.536133 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 11:20:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:20:34.549279 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:35.003285 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-ce3cfcb7-a96b-430e-8e89-08b75a90e12b admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:35.024438 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-ce3cfcb7-a96b-430e-8e89-08b75a90e12b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.480007 Aug 09 11:20:35.024997 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 9 11:20:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:20:35.060720 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG dbcounter [-] [103079] Writing DB stats nova_api:SELECT=14 {{(pid=103079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:35.064669 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-c21d9cd4-8eba-4c2a-a63b-7b7d91f000e5 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:35.073947 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-c21d9cd4-8eba-4c2a-a63b-7b7d91f000e5 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014641 Aug 09 11:20:35.074539 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Tue Aug 9 11:20:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:35.089436 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-0191bab7-5bfc-4331-8a68-64ac770f239b admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:35.099540 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-0191bab7-5bfc-4331-8a68-64ac770f239b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015748 Aug 09 11:20:35.100045 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Tue Aug 9 11:20:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:35.112944 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:35.121523 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012630 Aug 09 11:20:35.122105 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Tue Aug 9 11:20:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:20:35.134772 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-320ec06f-de38-43e5-bd70-568a27795beb admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:20:35.143946 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-320ec06f-de38-43e5-bd70-568a27795beb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013040 Aug 09 11:20:35.144474 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Tue Aug 9 11:20:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:23:49.851285 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:49.852571 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Aug 09 11:23:49.852981 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:49.996066 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_api:SELECT=6 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:50.177680 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-26b3c378-2a7d-46dd-8e43-a16d1cd2a41a admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:50.180155 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:23:50.180155 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: warnings.warn(msg) Aug 09 11:23:50.181512 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-26b3c378-2a7d-46dd-8e43-a16d1cd2a41a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:50.182009 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-26b3c378-2a7d-46dd-8e43-a16d1cd2a41a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:50.182448 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-26b3c378-2a7d-46dd-8e43-a16d1cd2a41a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:50.183236 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-26b3c378-2a7d-46dd-8e43-a16d1cd2a41a admin admin] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:50.183682 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-26b3c378-2a7d-46dd-8e43-a16d1cd2a41a admin admin] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:50.184090 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-26b3c378-2a7d-46dd-8e43-a16d1cd2a41a admin admin] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:50.218715 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-26b3c378-2a7d-46dd-8e43-a16d1cd2a41a admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.224311 Aug 09 11:23:50.219342 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 11:23:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:23:51.071012 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:51.072090 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 09 11:23:51.072456 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:23:51.274957 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-881fc7f1-cce1-4847-95af-dd7473010caa admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:23:51.277430 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:23:51.277430 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: warnings.warn(msg) Aug 09 11:23:51.278522 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-881fc7f1-cce1-4847-95af-dd7473010caa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:51.279040 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-881fc7f1-cce1-4847-95af-dd7473010caa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:51.279471 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-881fc7f1-cce1-4847-95af-dd7473010caa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:51.280189 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-881fc7f1-cce1-4847-95af-dd7473010caa admin admin] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:23:51.280634 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-881fc7f1-cce1-4847-95af-dd7473010caa admin admin] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:23:51.281047 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-881fc7f1-cce1-4847-95af-dd7473010caa admin admin] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:23:51.301067 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-881fc7f1-cce1-4847-95af-dd7473010caa admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.091162 Aug 09 11:23:51.301660 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 11:23:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:24:02.574440 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:02.575520 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 09 11:24:02.575904 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:02.727630 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_cell0:SELECT=4 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:02.728246 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_cell1:SELECT=4 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:02.729250 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG dbcounter [-] [103080] Writing DB stats nova_api:SELECT=8 {{(pid=103080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:02.783440 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-bf855841-ccb8-476b-8f11-cee4c124f074 admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:02.785944 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:24:02.785944 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: warnings.warn(msg) Aug 09 11:24:02.787092 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-bf855841-ccb8-476b-8f11-cee4c124f074 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:02.787566 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-bf855841-ccb8-476b-8f11-cee4c124f074 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:02.788026 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-bf855841-ccb8-476b-8f11-cee4c124f074 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:02.788749 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-bf855841-ccb8-476b-8f11-cee4c124f074 admin admin] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:02.789187 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-bf855841-ccb8-476b-8f11-cee4c124f074 admin admin] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:02.789597 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-bf855841-ccb8-476b-8f11-cee4c124f074 admin admin] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:02.815711 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-bf855841-ccb8-476b-8f11-cee4c124f074 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092575 Aug 09 11:24:02.816354 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 11:24:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:24:03.656007 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: DEBUG nova.api.openstack.wsgi [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] Calling method '>' {{(pid=103079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:03.657110 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: INFO nova.api.openstack.requestlog [None req-786b7ff6-4f64-4913-b240-616390497b41 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 09 11:24:03.657473 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: [pid: 103079|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 11:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:24:03.860359 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG nova.api.openstack.wsgi [None req-fe13f4af-327c-41a2-8479-40b47369a14d admin admin] Calling method '>' {{(pid=103080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:24:03.862907 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:24:03.862907 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: warnings.warn(msg) Aug 09 11:24:03.864031 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-fe13f4af-327c-41a2-8479-40b47369a14d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:03.864523 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-fe13f4af-327c-41a2-8479-40b47369a14d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:03.864949 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-fe13f4af-327c-41a2-8479-40b47369a14d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:03.865664 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-fe13f4af-327c-41a2-8479-40b47369a14d admin admin] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:24:03.866106 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-fe13f4af-327c-41a2-8479-40b47369a14d admin admin] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:24:03.866514 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: DEBUG oslo_concurrency.lockutils [None req-fe13f4af-327c-41a2-8479-40b47369a14d admin admin] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:24:03.887780 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: INFO nova.api.openstack.requestlog [None req-fe13f4af-327c-41a2-8479-40b47369a14d admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092223 Aug 09 11:24:03.888350 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: [pid: 103080|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 11:24:03 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:25:02.725709 dv-cinder-849890-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 11:25:02.731458 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: Tue Aug 9 11:25:02 2022 - graceful shutdown triggered... Aug 09 11:25:02.732178 dv-cinder-849890-5-iscsi devstack@n-api.service[103079]: Gracefully killing worker 1 (pid: 103079)... Aug 09 11:25:02.732556 dv-cinder-849890-5-iscsi devstack@n-api.service[103080]: Gracefully killing worker 2 (pid: 103080)... Aug 09 11:25:03.733349 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: worker 1 buried after 1 seconds Aug 09 11:25:03.733349 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: worker 2 buried after 1 seconds Aug 09 11:25:03.733349 dv-cinder-849890-5-iscsi devstack@n-api.service[103078]: goodbye to uWSGI. Aug 09 11:25:03.734987 dv-cinder-849890-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 11:25:03.735797 dv-cinder-849890-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 11:25:03.738837 dv-cinder-849890-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 11:25:03.749877 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 11:25:03 2022] *** Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: nodename: dv-cinder-849890-5-iscsi Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: machine: x86_64 Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: clock source: unix Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: pcre jit disabled Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: detected number of CPU cores: 4 Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: current working directory: / Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: detected binary path: /usr/bin/uwsgi-core Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: your processes number limit is 47680 Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: your memory page size is 4096 bytes Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: detected max file descriptor number: 2048 Aug 09 11:25:03.751950 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: lock engine: pthread robust mutexes Aug 09 11:25:03.753066 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: thunder lock: enabled Aug 09 11:25:03.753066 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 11:25:03.753066 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 11:25:03.792826 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: Python main interpreter initialized at 0x5645907879c0 Aug 09 11:25:03.792826 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: python threads support enabled Aug 09 11:25:03.792826 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: your server socket listen backlog is limited to 100 connections Aug 09 11:25:03.792826 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: your mercy for graceful operations on workers is 90 seconds Aug 09 11:25:03.793325 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 11:25:03.793325 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: *** Operational MODE: preforking *** Aug 09 11:25:03.796074 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: *** uWSGI is running in multiple interpreter mode *** Aug 09 11:25:03.796074 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: spawned uWSGI master process (pid: 117791) Aug 09 11:25:03.796074 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: spawned uWSGI worker 1 (pid: 117792, cores: 1) Aug 09 11:25:03.796074 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: spawned uWSGI worker 2 (pid: 117793, cores: 1) Aug 09 11:25:03.796074 dv-cinder-849890-5-iscsi devstack@n-api.service[117791]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 11:25:03.793696 dv-cinder-849890-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 11:25:04.475387 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 11:25:04.493567 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 11:25:05.622590 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:25:05.622590 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: from cryptography.utils import int_from_bytes Aug 09 11:25:05.623284 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:25:05.623284 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: from cryptography.utils import int_from_bytes Aug 09 11:25:05.644970 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:25:05.644970 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: from cryptography.utils import int_from_bytes Aug 09 11:25:05.645754 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:25:05.645754 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: from cryptography.utils import int_from_bytes Aug 09 11:25:07.991630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:25:07.992627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:25:07.992627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:25:07.992950 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:25:07.993122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:25:07.993385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.994081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.994081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.994313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.994635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.994979 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.995305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.995629 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.995945 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.996193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.996505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.996829 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-5-iscsi {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.997142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.997442 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.997745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.998056 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.998355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.998673 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.998999 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.999494 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:07.999939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.000244 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.000553 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.000895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.001205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.001507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.001835 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.002127 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.002432 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.002724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.003171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-5-iscsi {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.003516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.003808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.004119 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.004542 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.004847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.005154 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.005473 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.005865 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.006176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.006507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.006852 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.007162 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.007477 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.007775 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.008075 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.008385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.008697 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.009000 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.009299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.009545 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.009847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.010166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.010492 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.010799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.011072 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.011367 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.011621 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.011961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.012327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.012538 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.012839 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.013205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.013446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.013745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.014044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.014341 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.014660 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.015002 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.015322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.015623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.015940 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.016362 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.016587 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.016885 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.017251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.017537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.017840 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.018155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.018469 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.018769 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.019099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.019400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.019714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.020031 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.020327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.020575 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.020877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.021178 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.021676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.021982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.022161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:25:08.022949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.023118 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:25:08.023274 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.023274 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.023615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:25:08.023786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.023950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:25:08.024100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.024500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:25:08.024725 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.024904 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.025061 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.025216 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.025353 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.025538 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.025714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.025867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.026035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.026234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.026399 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.026564 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.026740 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.026957 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.027123 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.027279 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.027446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.027603 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.027780 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.027937 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.028110 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.028257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.028393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.028393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.028672 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849890-5-iscsi {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.028672 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.028940 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.029090 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.029223 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.029358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.029482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.029616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.029616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.029879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.029879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.030125 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.030249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.030393 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.030545 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.030681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.030867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.031019 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.031155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.031301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.031442 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.031572 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.031702 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.031834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.031977 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.032126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.032272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.032417 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.032564 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.032722 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.032878 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.035219 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.035415 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.035415 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.035744 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.035987 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.036160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.036333 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.036489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849890-5-iscsi {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.036745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.036915 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.037084 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.037315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.037475 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.037475 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.037837 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.038005 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.038179 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.038332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.038495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.038656 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.038831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.039005 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.039174 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.039332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.039504 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.039669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.039833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.039996 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.040180 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.040354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.040519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.040688 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.040856 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.040856 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.041161 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.041328 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.041505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.041663 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.041832 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.042000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.042163 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.042319 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.042476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.042631 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.042786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.043006 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.043208 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.043426 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.043636 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.043848 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.044059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.044283 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.044535 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.044735 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.044909 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.045349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.045532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.045745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.045905 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.046069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.046300 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.046525 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.046765 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.047034 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.047192 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.047405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.047572 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.047805 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.047978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.048142 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.048314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.048469 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.048637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.048916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.049071 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.049237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.049237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.049547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.049702 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.049880 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.050047 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.050215 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.050373 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.050527 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.050692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.050884 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.051049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.051210 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.051370 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.051525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.051525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.051831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.051831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.052136 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.052305 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.052462 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.052638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.052837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.052837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.053137 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.053288 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.053441 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.053608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.053779 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.053949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.054175 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.054343 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.054513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.054684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.054909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.055179 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.055545 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.055776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.056013 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.056228 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.056432 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.056636 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.056828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.056828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.057211 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.057412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.057594 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.057788 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.057980 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.058167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.058371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.058573 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.058755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.058980 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.059163 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.059359 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.059544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.059693 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.059827 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.060014 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.060199 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.060399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.060608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.060793 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.060983 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.061172 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.061359 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.061566 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.061795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.062000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.062166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.062333 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.062503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.062637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.062851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.063013 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.063164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.063271 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.063358 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.063446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.063545 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.063640 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.063640 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.063857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.063946 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.064085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.064191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.064279 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.064417 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.064520 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.064609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.064695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.064785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.064882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.064970 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.065069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.065164 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.065297 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.065426 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.065583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.065723 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.065872 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.066001 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.066143 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.066281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.066418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.066555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.066685 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.066830 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.066972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.067071 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.067147 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.067238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.067320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.067401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.067526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.067632 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.067729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.067831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.067918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.068015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.068109 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.068196 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.068376 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.068483 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.068579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.068710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.068808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.068808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.069034 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.069133 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.069219 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.069304 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.069396 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.069490 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.069585 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.069672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.069765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.069856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.069987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.070077 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.070215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.070306 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.070392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:25:08.070483 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.070613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.070703 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.070890 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.070997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071162 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071162 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071322 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071322 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071532 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071610 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071766 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071846 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071846 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.071984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072136 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072370 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072771 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.072996 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073074 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073235 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073475 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073572 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073657 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073817 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.073974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.074053 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.074134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.074323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.074455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.074575 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.074712 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.074873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.075023 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.075162 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.075287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.075399 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.075508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.075627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.075747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.075865 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.075994 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.076123 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.076252 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.076389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.076389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.076640 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.076776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.076912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.077050 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.077187 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.077318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.077445 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.077579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.077669 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.077798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.077900 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.077986 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078068 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078306 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078387 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078468 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078547 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078706 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.078906 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.079037 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.079169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.079281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.079398 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.080427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.080427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.080905 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.081038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.081278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.081420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.081560 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.081666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.081666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.081892 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.082002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.082119 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.082285 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.082437 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.082542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.082630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.082775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.082913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.083019 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.083137 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.083260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.083399 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.083542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.083747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.083941 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.084066 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.084153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.084247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.084393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.084495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.084720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.084818 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.085033 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.085162 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.085344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.085493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.085651 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.085745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.085967 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.086069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.086278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.086381 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.086584 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.086726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.086914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.087049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.087229 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.087376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.087544 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.087647 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.087853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.087977 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.088425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.088529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.088616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.088702 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.088787 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.088880 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.089061 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.089163 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.089369 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.089473 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.089675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.089780 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.089976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.090069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.090278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.090382 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.090586 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.090679 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.090942 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.091049 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.091247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.091349 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.091562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.091655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.091878 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.091975 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.092194 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.092287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.092497 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.092604 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.092803 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.092900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.093106 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.093209 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.093410 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.093517 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.093712 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.093812 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.094021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.094118 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.094323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.094432 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.094625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.094718 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.095135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.095292 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.095292 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.095460 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.095544 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.095666 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.095866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.096001 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.096239 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.096395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.096527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.096620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.096778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.096911 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.097050 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.097195 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.097349 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.097490 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.097688 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.097811 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.098011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.098262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.098401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.098631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.098799 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.098941 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.099099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.099297 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.099412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.099602 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.099786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.099931 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.100087 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.100288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.100393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.100543 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.100764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.100913 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.101031 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.101166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.101291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.101455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.101552 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.101756 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.102216 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.102418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.102522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.102724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.102876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.103052 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.103147 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.103355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.103464 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.103656 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.103778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.103961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.104127 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.104260 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.104367 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.104559 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.104661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.104856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.104958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.105158 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.105315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.105472 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.105567 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.105776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.105891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.106087 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.106207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.106384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.106491 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.106713 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.106890 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.107035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.107130 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.107326 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.107422 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.107626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.107730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.107931 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.108056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.108265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.108404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.108565 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.108669 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.109024 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.109149 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.109269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.109379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.109609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.109799 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.110446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.110777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.111032 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.111293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.111606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.111922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.112246 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.112555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.112868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.113179 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.113408 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.113630 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.113844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.114008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.114222 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.114401 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.114621 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.114894 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.115161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.115394 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.115564 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.115738 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.115964 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.116205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.116381 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.116548 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.116719 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.116883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.117075 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.117299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.117464 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.117667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.117823 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.117969 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.118191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.118345 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.118556 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.118556 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.118935 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.119087 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.119246 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.119420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.119577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.119760 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.119933 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.120113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.120272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.120417 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.120561 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.120754 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.120963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.121143 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.121306 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.121451 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.121451 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.121731 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.121891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.122099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.122198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.122333 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.122425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.122556 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.122691 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.122871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.123018 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.123184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.123276 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.123423 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.123515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.123663 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.123821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.123980 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.124079 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.124176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.124358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.124486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.124563 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.124707 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.124798 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.124929 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.125029 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.125146 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.125292 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.125292 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.125621 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.125784 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.126001 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.126257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.126493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.126739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.126739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.127153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.127316 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.127468 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.127644 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.127806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.128013 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.128239 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.128239 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.128513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.128608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.128783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.128917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.129057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.129206 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.129337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.129495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.129650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.129857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.130115 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.130298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.130458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.130458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.130748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.130963 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.131073 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.131279 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.131279 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.131452 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.131702 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.131702 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.132119 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.132357 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.132587 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.132777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.133014 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.133164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.133326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.133326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.134070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.134233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.134375 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.134515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.134648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.134784 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.135002 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.135155 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.135155 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.135476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.135631 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.135815 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.135980 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.136166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.136353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.136498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.136741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.136882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.136999 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.137100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.137215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.137334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.137433 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.137529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.137636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.137725 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.137858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.137982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.138078 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.138257 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.138425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.138606 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.138760 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.138871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.138974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.139098 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.139192 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.139286 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.139391 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.139500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.139656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.139808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.139961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.140143 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.140343 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.140508 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.140664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.140821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.140965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.141169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.141326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.141472 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.141628 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.141785 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.141947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.142088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.142245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.142394 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.142624 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.142784 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.142930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.143038 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.143129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.143216 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.143313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.143410 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.143498 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.143611 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.143774 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.143935 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.144102 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.144251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.144405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.144557 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.144710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.144886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.145038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.145203 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.145358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.145509 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.145698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.145917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.146128 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.146365 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.146612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.146770 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.147036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.147204 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.147361 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.147526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.147689 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.147689 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.148034 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.148215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.148369 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.148531 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.148753 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.148959 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.149130 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.149231 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.149319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.149414 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.149503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.149605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.149729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.149826 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.149966 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.150065 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.150153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.150293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.150439 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.150570 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.150709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.150832 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.150923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.151060 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.151170 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.151312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.151450 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.151548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.151636 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.151737 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.151826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.151919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.152006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.152132 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.152282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.152451 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.152608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.152762 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.152986 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.153202 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.153303 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.153406 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.153496 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.153591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.153705 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.153834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.154026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.154136 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.154355 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.154473 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.154651 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.154758 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.154977 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.155117 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.155282 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.155430 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.155583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.155740 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.155928 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.156232 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.156324 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.156591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.156746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.156900 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.157038 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.157270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.157595 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.157917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.158134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.158355 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.158678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.162865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.162865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163194 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163277 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163369 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163596 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.163975 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164142 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164215 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164375 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164748 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164828 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164907 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.164980 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165348 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165497 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165581 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165661 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165742 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165815 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.165963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.166043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.166122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.166200 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.166279 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.166351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.166429 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.166512 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.166591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.166930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.167034 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.167197 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.167510 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.167819 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.168157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.168469 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.168718 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.168831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.169071 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.169380 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.169598 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.169699 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.169981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.170083 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.170428 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.170744 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.170957 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.171093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.171376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.171478 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.171685 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.171996 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.172093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.172313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.172582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.172674 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.172926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.173172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.173356 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.173672 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.173981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.174074 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.174293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.174591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.174698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.174922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.175220 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.175313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.175547 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.175805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.175906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.176143 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.176359 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.176450 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.176756 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.176907 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.177063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.177385 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.177482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.177883 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.178195 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.178509 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.178952 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.179064 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.179270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.179580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.179757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.179922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.180173 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.180365 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.180513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.180777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.180971 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.181139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.181385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.181556 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.181726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.181874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.182059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.182201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.182369 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.182519 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.182666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.182867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.183015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.183135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.183310 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.183492 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.183695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.183938 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.184074 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.184254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.184371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.184578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.184695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.184904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.185059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.185204 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.185357 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.185524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.185645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.185833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.185925 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.186149 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.186264 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.186458 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.186584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.186760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.186909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.187146 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.187265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.187456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.187635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.187817 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.188319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.188452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.188589 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.188713 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.188853 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.188995 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.189164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.189312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.189458 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.189601 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.189751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.190114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.190327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.190440 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.190570 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.190896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.191085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.191345 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.191669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.191910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.192110 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.192294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.192478 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.192661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.192843 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.193017 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.193264 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.193465 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.193658 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.193862 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.194001 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.194132 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.194265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.194265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.194265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.194722 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.194722 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.195017 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.195142 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.195267 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.195390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.195704 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.195849 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.195992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.196123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.196266 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.196416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.196545 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.196656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.196731 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.196802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.196898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.196997 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.197118 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.197215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.197391 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.197518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.197746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.197855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.198055 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.198361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.198699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.199134 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.199366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.199696 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.200020 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.200336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.200648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.200968 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.201331 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.201646 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.202209 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.202526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.202874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.203183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.203492 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.203791 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.203925 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.204230 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.204417 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.204611 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.204730 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.204991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.205141 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.205317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.205567 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.205752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.205941 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.206132 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.206259 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.206579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.206717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.207172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.207489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.207670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.207801 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.208362 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.208507 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.208672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.209166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.209499 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.210023 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.210397 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.210649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.210918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.211275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.211474 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.211474 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.212016 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.212245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.212418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.212418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.212664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.212811 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.212958 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.213121 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.213329 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.213985 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.214155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.214389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.214801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.215064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.215266 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.215525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.215831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.215980 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.216193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.216600 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.216760 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.216998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.217188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.217326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.217464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.217767 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.217962 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.218102 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.218363 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.218615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.218976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.219290 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.219687 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.219920 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.220110 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.220334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.220627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.220807 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.221008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.221206 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.221493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.221713 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.222012 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.222200 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.222396 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.222609 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.222983 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.223190 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.223371 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.223554 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.223554 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.223881 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.224065 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.224065 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.224418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.224633 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.225005 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.225208 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.225208 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.225572 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.225761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.225761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.226154 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.226361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.226361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.226735 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.227313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.227528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.227528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.227906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.228117 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.228258 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.228476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.228796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.229110 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.229247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.229433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.229754 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.230069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.230742 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.230966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.231138 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.231310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.231482 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.231729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.231964 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.232167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.232328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.232559 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.232706 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.232855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.233176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.233360 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.233572 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.233818 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.234093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.234093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.234556 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.234957 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.235397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.235554 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.235697 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.235837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.235987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.236144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.236144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.236438 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.236580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.236580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.236924 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.237272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.237272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.237708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.237951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.238181 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.238405 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.238647 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.238896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.239148 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.239334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.239511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.239670 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.239670 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.239947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.240121 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.240302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.240491 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.240683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.240970 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.240970 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.240970 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.240970 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.241562 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.241779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.241779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.242277 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.242438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.242579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.242579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.242877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.243026 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.243177 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.243319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.243518 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.243675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.243885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.244041 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.244222 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.244367 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.244550 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.244703 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.244876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.245033 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.245183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.245341 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.245649 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.245797 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.246017 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.246187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.246342 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.246482 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.246676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.246861 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.247077 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.247234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.247406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.247563 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.247731 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.247873 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.248028 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.248328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.248480 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.248631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.248780 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.248942 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.249124 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.249282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.249471 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.249631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.249830 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.250136 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.250289 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.250431 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.250728 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.250932 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.251186 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.251341 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.251483 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.251630 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.251780 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.251928 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.252190 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.252190 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.252483 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.252631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.252785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.252927 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.253067 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.253214 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.253354 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.253496 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.253645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.253796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.253946 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.254087 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.254238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.254386 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.254541 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.254691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.254853 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.255008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.255156 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.255416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.255566 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.255891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.256039 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.256179 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.256327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.256487 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.256637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.256778 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.256925 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.257065 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.257205 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.257353 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.257493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.257634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.257772 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.258000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.258153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.258302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.258460 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.258609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.258750 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.258987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.259145 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.259293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.259434 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.259579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.259723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.259989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.260187 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.260334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.260649 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.260817 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.260961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.261222 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.261488 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.261635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.261776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.261917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.262056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.262226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.262488 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.262635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.262777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.262960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.263102 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.263257 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.263406 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.263547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.263686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.263826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.263975 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.264125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.264265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.264412 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.264560 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.264716 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.264868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.265021 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.265170 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.265453 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.265605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.265746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.265918 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.266249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.266398 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.266547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.266696 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.266922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.267092 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.267405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.267553 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.267723 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.267871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.268064 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.268329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.268485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.268656 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.268802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.268991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.269146 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.269377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.269540 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.269683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.269823 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.270027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.270182 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.270379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.270720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.270909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.271133 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.271559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.271727 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.271870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.272045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.272352 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:25:08.272733 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.272940 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.273278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.273804 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.274149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.274469 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.274786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.276792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.276792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.276792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.276792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.276792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.276792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.278801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.278801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.278801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.278801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.278801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.278801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.278801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.279969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.279969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.279969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.281141 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.281141 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.281659 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.281964 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.282295 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.282791 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.283640 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.283640 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.283978 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.284289 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.284433 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.288156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.288156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.288156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.288156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.288156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.288156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.288156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.288156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.289894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.289894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.289894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.289894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.289894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.291257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.291257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.291257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.291870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.292258 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.292576 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.293155 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.293400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.293680 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.294005 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.294318 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.294632 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.294981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.295299 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.295612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.295927 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.296237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.296552 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.296862 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.297175 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.297486 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.297796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.298112 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.298421 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.298974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.299213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.299436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.299699 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.299989 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.300379 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.301141 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.301879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.302563 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.303313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.303879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.304158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.304528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.304862 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.305250 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.305737 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.306031 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.306375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.306730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.307089 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.307413 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.307726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.308040 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.308358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.308708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.309270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.309528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.309764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.310036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.310411 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.310738 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.311506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.312183 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.312512 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.312833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.313491 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.313753 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.313981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.314596 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.314955 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.315211 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.315459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.315747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.316150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.316714 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.317049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.317287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.317526 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.317862 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.318204 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.318658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.319213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.320090 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.320090 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.320627 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:25:08.320627 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:25:08.463023 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Registered counter for database nova_api Aug 09 11:25:08.487242 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:25:08.498260 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:25:08.532511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO dbcounter [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Registered counter for database nova_api Aug 09 11:25:08.564847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_db.sqlalchemy.engines [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:25:08.572617 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writer thread running {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:25:08.585214 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.context [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4705de16-1b33-4787-8512-7dde2b8ef61e(cell1) {{(pid=117793) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 11:25:08.589441 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:08.589922 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:08.591556 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:08.592311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:08.592752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:08.594788 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:08.596987 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Registered counter for database nova_cell0 Aug 09 11:25:08.601761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Registered counter for database nova_cell1 Aug 09 11:25:08.610628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:25:08.616057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:25:08.616749 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:25:08.643055 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.context [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4705de16-1b33-4787-8512-7dde2b8ef61e(cell1) {{(pid=117792) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 11:25:08.647784 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:08.647980 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:08.649476 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:08.650257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:25:08.650717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:25:08.652825 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:25:08.655091 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO dbcounter [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Registered counter for database nova_cell0 Aug 09 11:25:08.659663 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO dbcounter [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Registered counter for database nova_cell1 Aug 09 11:25:08.670343 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_db.sqlalchemy.engines [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:25:08.675546 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_db.sqlalchemy.engines [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:25:08.676420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writer thread running {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:25:08.762679 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:25:08.774749 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Registered counter for database nova_cell0 Aug 09 11:25:08.785394 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:25:08.792971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:25:08.863512 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writer thread running {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:25:08.879699 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO dbcounter [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Registered counter for database nova_cell0 Aug 09 11:25:08.889654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_db.sqlalchemy.engines [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:25:08.895248 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writer thread running {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:25:09.154728 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:25:09.162453 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:25:09.214184 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: WARNING keystonemiddleware.auth_token [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:25:09.221759 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: WARNING keystonemiddleware.auth_token [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:25:09.520742 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:25:09.527303 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-e656ca9b-5294-496d-96df-e888b7607a28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:25:09.533917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5645907879c0 pid: 117793 (default app) Aug 09 11:25:09.572574 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: WARNING keystonemiddleware.auth_token [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 11:25:09.578863 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: WARNING keystonemiddleware.auth_token [None req-a430e707-7650-49fc-9366-6d0efb56e60e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 11:25:09.585516 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5645907879c0 pid: 117792 (default app) Aug 09 11:25:44.710660 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:44.712241 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:44.713504 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:44.714579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:45.639881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e1e08f52-e7e5-4a38-bfdd-50e2c80fd9c2 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Action: 'create', calling method: .version_select at 0x7fece465ee50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1333022085"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:25:46.059408 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:46.060507 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:46.061257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:46.063322 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:47.722851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dbbea547-f591-4dcc-bb25-03390d86a3f5 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Action: 'create', calling method: .version_select at 0x7fece45b0dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2083922316", "metadata": {"Type": "work"}}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:25:48.030851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e1e08f52-e7e5-4a38-bfdd-50e2c80fd9c2 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.312793 Aug 09 11:25:48.030851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Aug 9 11:25:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3316 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 11:25:48.030851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5ce6c84f-905f-4469-b9bf-aef397cf9cae tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece442aca0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:48.546502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5ce6c84f-905f-4469-b9bf-aef397cf9cae tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6" status: 200 len: 345 microversion: 2.1 time: 0.523176 Aug 09 11:25:48.547240 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 2/2] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:48 2022] GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6 => generated 345 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:25:49.262092 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-dbbea547-f591-4dcc-bb25-03390d86a3f5 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.208569 Aug 09 11:25:49.263106 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 9 11:25:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3211 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 11:25:49.276648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0e3951cb-c919-410b-836b-ffe3c110d6a2 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece443d3a0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:49.416843 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0e3951cb-c919-410b-836b-ffe3c110d6a2 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 353 microversion: 2.1 time: 0.143283 Aug 09 11:25:49.417826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 3/4] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:49 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:49.562268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-50023fe2-757b-454f-b4c9-cc88bf7b79bc tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece44a0c10>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:49.740336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-50023fe2-757b-454f-b4c9-cc88bf7b79bc tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6" status: 200 len: 346 microversion: 2.1 time: 0.182534 Aug 09 11:25:49.755129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 2/5] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:49 2022] GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6 => generated 346 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:49.756049 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eb2b9ea7-0f0b-4c79-b7ae-b6ac598b268c tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Action: 'create', calling method: .version_select at 0x7fece443da60>, body: {"snapshot": {"volume_id": "663bc8f1-3f61-4777-8132-5bcc5ed462a6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1660833585"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:25:50.378461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-eb2b9ea7-0f0b-4c79-b7ae-b6ac598b268c tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.627521 Aug 09 11:25:50.414708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 4/6] 10.222.0.59 () {60 vars in 1162 bytes} [Tue Aug 9 11:25:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:50.420612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8ed14a18-cf5f-41e3-adc1-f176f19569f9 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece44403a0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:50.431965 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8dd6ae03-aaeb-4200-889d-e587478a8389 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece443ddc0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:50.524856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8dd6ae03-aaeb-4200-889d-e587478a8389 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 354 microversion: 2.1 time: 0.097578 Aug 09 11:25:50.525966 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 5/7] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:50 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:50.539579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0e1457c8-6eed-4aa1-a1a0-49478441508c tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece443d550>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:50.579958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8ed14a18-cf5f-41e3-adc1-f176f19569f9 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 200 len: 287 microversion: 2.1 time: 0.190885 Aug 09 11:25:50.589176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 3/8] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:50 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 287 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:50.595073 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bab97fc1-2b7f-426d-8d32-de659f08da24 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece4440a60>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:50.638914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0e1457c8-6eed-4aa1-a1a0-49478441508c tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 354 microversion: 2.1 time: 0.103911 Aug 09 11:25:50.640079 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 6/9] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:50 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:25:50.660746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-45e9c15a-4e13-427e-b32a-c2df1f95a798 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece442adc0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:50.680225 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bab97fc1-2b7f-426d-8d32-de659f08da24 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.089629 Aug 09 11:25:50.680782 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 4/10] 10.222.0.59 () {58 vars in 1140 bytes} [Tue Aug 9 11:25:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:50.692774 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1ac0c891-a55d-4d03-8e45-389ca9ed8893 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece4440dc0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:50.743619 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1ac0c891-a55d-4d03-8e45-389ca9ed8893 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 200 len: 287 microversion: 2.1 time: 0.054738 Aug 09 11:25:50.744647 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 5/11] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:50 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:50.784098 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-45e9c15a-4e13-427e-b32a-c2df1f95a798 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 202 len: 0 microversion: 2.1 time: 0.127234 Aug 09 11:25:50.784864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 7/12] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:25:50 2022] DELETE /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:25:50.793371 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-49af82c3-3b90-4dfe-b5aa-f3425d25e304 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece4440550>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:50.859337 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-26ad6095-c738-4afa-8119-890a25f3d16d tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece442aca0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:50.890273 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-49af82c3-3b90-4dfe-b5aa-f3425d25e304 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 353 microversion: 2.1 time: 0.101200 Aug 09 11:25:50.891560 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 6/13] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:50 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:25:50.940770 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-26ad6095-c738-4afa-8119-890a25f3d16d tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/b7d0e077-6195-496e-9cca-e01edd1a1fd5" status: 200 len: 350 microversion: 2.1 time: 0.085666 Aug 09 11:25:50.948777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 8/14] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:50 2022] GET /compute/v2.1/os-volumes/b7d0e077-6195-496e-9cca-e01edd1a1fd5 => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:51.756995 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-51cde000-5354-4bbb-a7fe-b07793b1ff27 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece44a0d30>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:51.823027 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-51cde000-5354-4bbb-a7fe-b07793b1ff27 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 200 len: 287 microversion: 2.1 time: 0.069995 Aug 09 11:25:51.823750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 7/15] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:51 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:51.904675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9a8300c6-51e6-463d-88ea-73149d0d2d13 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece443d430>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:52.023963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9a8300c6-51e6-463d-88ea-73149d0d2d13 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 353 microversion: 2.1 time: 0.123224 Aug 09 11:25:52.024762 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 9/16] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:51 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:52.836172 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-95742e18-9798-48b4-b9b2-c911cd420aed tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece44a0ca0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:52.881908 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-95742e18-9798-48b4-b9b2-c911cd420aed tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 200 len: 287 microversion: 2.1 time: 0.050152 Aug 09 11:25:52.882843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 8/17] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:52 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:53.039549 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-95888df1-92fb-4077-9f81-803d762eb918 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece443dd30>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:53.148507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-95888df1-92fb-4077-9f81-803d762eb918 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 353 microversion: 2.1 time: 0.113658 Aug 09 11:25:53.149308 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 10/18] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:53 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:53.898265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a64f133a-0c8d-400e-a29d-5c2e6f7c7100 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece4440310>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:53.993221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a64f133a-0c8d-400e-a29d-5c2e6f7c7100 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 200 len: 287 microversion: 2.1 time: 0.095048 Aug 09 11:25:53.996473 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 9/19] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:53 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:54.162898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1e2fadd6-3a13-4131-8d73-abe59c8a6657 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece443ddc0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:54.262349 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1e2fadd6-3a13-4131-8d73-abe59c8a6657 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 353 microversion: 2.1 time: 0.103722 Aug 09 11:25:54.263285 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 11/20] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:54 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:55.010930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2454df16-e295-463c-8786-246677973ed9 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece4440c10>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:55.088703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2454df16-e295-463c-8786-246677973ed9 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 200 len: 287 microversion: 2.1 time: 0.084908 Aug 09 11:25:55.089357 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 10/21] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:55 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:55.277854 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-208d50ba-2293-443d-9bf9-0e2d1017bc38 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece443d550>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:55.395859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-208d50ba-2293-443d-9bf9-0e2d1017bc38 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 353 microversion: 2.1 time: 0.123501 Aug 09 11:25:55.396825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 12/22] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:55 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:56.104163 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-94b11ca4-bafb-4c45-a1b4-cd60f6b6f92e tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece443c280>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:56.169623 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-94b11ca4-bafb-4c45-a1b4-cd60f6b6f92e tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 200 len: 287 microversion: 2.1 time: 0.071631 Aug 09 11:25:56.170473 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:56 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:25:56.413471 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ce2a762-8327-432b-b163-b59626d3ef71 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece442ad30>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:56.578960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9ce2a762-8327-432b-b163-b59626d3ef71 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 353 microversion: 2.1 time: 0.170335 Aug 09 11:25:56.583948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 13/24] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:56 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:57.183983 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6b14816c-8406-4e12-aa31-92e0842aa73d tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece4440d30>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:57.246956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6b14816c-8406-4e12-aa31-92e0842aa73d tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 200 len: 288 microversion: 2.1 time: 0.067670 Aug 09 11:25:57.248293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 12/25] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:57 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 288 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:57.259872 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eeac57b0-439d-400a-a370-a5de7b1d1596 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece443e5e0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:57.417484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-eeac57b0-439d-400a-a370-a5de7b1d1596 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 202 len: 0 microversion: 2.1 time: 0.161645 Aug 09 11:25:57.425459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 14/26] 10.222.0.59 () {58 vars in 1254 bytes} [Tue Aug 9 11:25:57 2022] DELETE /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:25:57.427137 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2e65f367-46a7-4ccb-b232-68f999d255bc tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece4440430>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:57.495366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2e65f367-46a7-4ccb-b232-68f999d255bc tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 200 len: 287 microversion: 2.1 time: 0.072577 Aug 09 11:25:57.500817 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 13/27] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:57 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:57.604288 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eacada63-8ba5-43fb-b726-3d8c9d8059c1 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece442aca0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:57.751263 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-eacada63-8ba5-43fb-b726-3d8c9d8059c1 tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 200 len: 353 microversion: 2.1 time: 0.162042 Aug 09 11:25:57.753191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 15/28] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:57 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:58.236136 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-864bd068-777d-446c-a149-e7ad9698247b tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece44a0ee0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:58.376368 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-864bd068-777d-446c-a149-e7ad9698247b tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/333da82e-67e3-48f7-a87f-edf880a51fef" status: 200 len: 350 microversion: 2.1 time: 0.144065 Aug 09 11:25:58.388663 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 14/29] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:58 2022] GET /compute/v2.1/os-volumes/333da82e-67e3-48f7-a87f-edf880a51fef => generated 350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:25:58.508455 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1a97d312-f071-4f91-8718-afd4b65f9b9b tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece443d550>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:58.765537 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c622f0f3-bf41-4bdd-98b3-5bd8c4bf859a tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Calling method '.version_select at 0x7fece443c550>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:25:59.328527 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-1a97d312-f071-4f91-8718-afd4b65f9b9b tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] HTTP exception thrown: Snapshot 3c70137a-8694-482a-a7a8-399beaca9926 could not be found. Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1a97d312-f071-4f91-8718-afd4b65f9b9b tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Request method failure captured: Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 HTTP/1.1 Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kQ4120HIIsNEsDosiedSoQqBJd_PTp_rmB6GNZxeW80_H7MCt-GWzmm4Y74vv9GOmn5itXKoa17SmelUIPLCvQLSYQh7O_ELUUWj0_IFoN7G6eP9XCpR82c4-vICAKUTXxrtTMNDvC5c8the2qRNm3lFAfmmOCC61Bh3ScRQN-VEOs Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 6c60c68e5637481bba22ab515ee1698c Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:25:59.335603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6c60c68e5637481bba22ab515ee1698c", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 6c60c68e5637481bba22ab515ee1698c Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesSnapshotsTestJSON-698795590-project Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 22876106e28646eabfcfb43e191bccd7 Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesSnapshotsTestJSON-698795590-project Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Snapshot 3c70137a-8694-482a-a7a8-399beaca9926 could not be found. Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '3c70137a-8694-482a-a7a8-399beaca9926'} Aug 09 11:25:59.337004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3c70137a-8694-482a-a7a8-399beaca9926 could not be found. (HTTP 404) (Request-ID: req-96bc90a5-05db-4a7f-9910-d42b4b178368) Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.337896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:59.339167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3c70137a-8694-482a-a7a8-399beaca9926 could not be found. Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 11:25:59.340317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3c70137a-8694-482a-a7a8-399beaca9926 could not be found. Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3c70137a-8694-482a-a7a8-399beaca9926 could not be found. Aug 09 11:25:59.341585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.344453 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1a97d312-f071-4f91-8718-afd4b65f9b9b tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Returning 404 to user: Snapshot 3c70137a-8694-482a-a7a8-399beaca9926 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:59.345682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1a97d312-f071-4f91-8718-afd4b65f9b9b tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926" status: 404 len: 111 microversion: 2.1 time: 0.841601 Aug 09 11:25:59.348711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 16/30] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:25:58 2022] GET /compute/v2.1/os-snapshots/3c70137a-8694-482a-a7a8-399beaca9926 => generated 111 bytes in 845 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:25:59.366500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-c622f0f3-bf41-4bdd-98b3-5bd8c4bf859a tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] HTTP exception thrown: Volume 6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f could not be found. Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c622f0f3-bf41-4bdd-98b3-5bd8c4bf859a tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Request method failure captured: Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f HTTP/1.1 Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kQ56o3u7RLN-wiB4e1JTQFyKThgpjG60uD4XTVFKNSVyIYDDraGhajrxS5AlAaP5WX_gL_GanHZ9-5A0Uj6LLVD9a30-4qvqwuRKUL-F5kQCT6fzHsbYCaDgjjzfyhaRUP6Q69HspS8t95EFjVLTEFwxAOtTmZxECzbI6svB57MXlw Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 0008ea6d586e4d34a3f505d9d9893034 Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesGetTestJSON-605617483 Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:25:59.375684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0008ea6d586e4d34a3f505d9d9893034"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0008ea6d586e4d34a3f505d9d9893034"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0008ea6d586e4d34a3f505d9d9893034"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0008ea6d586e4d34a3f505d9d9893034", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesGetTestJSON-605617483 Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 0008ea6d586e4d34a3f505d9d9893034 Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesGetTestJSON-605617483 Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesGetTestJSON-605617483-project Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: a353be6a7032483a96a85524196b0e8c Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesGetTestJSON-605617483-project Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Volume 6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f could not be found. Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f'} Aug 09 11:25:59.376949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f could not be found. (HTTP 404) (Request-ID: req-2f87a206-dbdc-42a2-8e29-796988ca4b9b) Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:59.377781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:25:59.379077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f could not be found. Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 11:25:59.380233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f could not be found. Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f could not be found. Aug 09 11:25:59.381489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:25:59.384884 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c622f0f3-bf41-4bdd-98b3-5bd8c4bf859a tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] Returning 404 to user: Volume 6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:25:59.388129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c622f0f3-bf41-4bdd-98b3-5bd8c4bf859a tempest-VolumesGetTestJSON-605617483 tempest-VolumesGetTestJSON-605617483-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f" status: 404 len: 109 microversion: 2.1 time: 0.626195 Aug 09 11:25:59.388734 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 15/31] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:25:58 2022] GET /compute/v2.1/os-volumes/6a6b190a-8af1-4dc6-b36a-b95e69ad5d8f => generated 109 bytes in 628 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:25:59.688090 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-349776165", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:25:59.941805 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-aa6aace5-bba9-4d1a-87c7-7a51f9114d8a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: .version_select at 0x7fece443c790>, body: {"keypair": {"name": "tempest-keypair-644904299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDTW2n5Dd1vA+5WcYI8JDKkJR2PVaD+l1WGv2cFsmRqQsznoEtFAa3DEAexLC6QDFJUoS50V9FQqe52syeOEQPP2V4CwK/QNACn6FYcyy4bx3wcQUIW6JR1FLkztC3ACw=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:25:59.949314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] validate_networks() for [('cada0da3-73dc-4829-967e-cf7277f4eed4', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:26:00.058993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-aa6aace5-bba9-4d1a-87c7-7a51f9114d8a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:26:00.072217 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-aa6aace5-bba9-4d1a-87c7-7a51f9114d8a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for user 8512df3e232c4fd59b7abad4e6e05c9d and project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:26:00.213164 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-aa6aace5-bba9-4d1a-87c7-7a51f9114d8a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.820341 Aug 09 11:26:00.213990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 16/32] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:25:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:00.219084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ce58d3e4-2e5c-410e-a49a-a15b12f07941 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece3b32280>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:00.388904 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ce58d3e4-2e5c-410e-a49a-a15b12f07941 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6" status: 202 len: 0 microversion: 2.1 time: 0.173584 Aug 09 11:26:00.389732 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 17/33] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:26:00 2022] DELETE /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:26:01.048296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-46819182", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "networks": [{"uuid": "68de9dcf-8617-4223-bbfb-3e93249b2f9f"}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:01.236497 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] validate_networks() for [('68de9dcf-8617-4223-bbfb-3e93249b2f9f', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:26:01.868440 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:26:01.868966 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:26:01.869321 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:26:01.869830 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:26:01.870131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:26:01.900891 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:01.901381 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:01.901982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:01.903535 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:01.904145 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:01.904746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:02.011818 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Getting quotas for project b0a6fd5299a7475bad7836d22b23967d. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:26:02.037815 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Getting quotas for user 8f9dc600fea34effa2afa8aee54aab7e and project b0a6fd5299a7475bad7836d22b23967d. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:26:02.072354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:26:02.077953 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:26:02.257602 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3ef0ca0a-d2a1-4d98-abb6-8217f5d3397e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.907594 Aug 09 11:26:02.258449 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 17/34] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:25:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:26:02.265809 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7fa38bff-b036-4e6a-8802-105fbd7c39cf tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece3ac5040>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:02.299303 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-7fa38bff-b036-4e6a-8802-105fbd7c39cf tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] HTTP exception thrown: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7fa38bff-b036-4e6a-8802-105fbd7c39cf tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Request method failure captured: Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6 HTTP/1.1 Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kQ4120HIIsNEsDosiedSoQqBJd_PTp_rmB6GNZxeW80_H7MCt-GWzmm4Y74vv9GOmn5itXKoa17SmelUIPLCvQLSYQh7O_ELUUWj0_IFoN7G6eP9XCpR82c4-vICAKUTXxrtTMNDvC5c8the2qRNm3lFAfmmOCC61Bh3ScRQN-VEOs Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 6c60c68e5637481bba22ab515ee1698c Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:26:02.305826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6c60c68e5637481bba22ab515ee1698c", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 6c60c68e5637481bba22ab515ee1698c Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesSnapshotsTestJSON-698795590-project Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 22876106e28646eabfcfb43e191bccd7 Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesSnapshotsTestJSON-698795590-project Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '663bc8f1-3f61-4777-8132-5bcc5ed462a6'} Aug 09 11:26:02.307013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. (HTTP 404) (Request-ID: req-d2032e51-2bd0-431e-909e-f41a4dc1f958) Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:02.307638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:26:02.308577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 11:26:02.309618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.310711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.313941 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7fa38bff-b036-4e6a-8802-105fbd7c39cf tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Returning 404 to user: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:02.323181 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7fa38bff-b036-4e6a-8802-105fbd7c39cf tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6" status: 404 len: 109 microversion: 2.1 time: 0.055349 Aug 09 11:26:02.324388 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 18/35] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:26:02 2022] GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:26:02.332750 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2d3ce96f-32e8-49d5-b4a5-f954390bee26 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece4db2040>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:02.447322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2d3ce96f-32e8-49d5-b4a5-f954390bee26 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ed48d009-f70a-499b-809c-229407f87cff" status: 200 len: 351 microversion: 2.1 time: 0.121531 Aug 09 11:26:02.448147 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 19/36] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:26:02 2022] GET /compute/v2.1/os-volumes/ed48d009-f70a-499b-809c-229407f87cff => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:02.461164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8907c1e6-ef7c-4069-aba9-181927b3b534 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:02.462135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8907c1e6-ef7c-4069-aba9-181927b3b534 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:02.671272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8907c1e6-ef7c-4069-aba9-181927b3b534 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:02.689991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:26:02.691075 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:26:02.691813 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:26:02.692370 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:26:02.692942 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:26:02.700778 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8907c1e6-ef7c-4069-aba9-181927b3b534 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1221 microversion: 2.1 time: 0.251367 Aug 09 11:26:02.714855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 20/37] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:02 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1221 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:02.717437 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-adf38273-caac-493e-8be8-2a5e74290788 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece3add550>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:02.728670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:02.729167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:02.729601 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:02.730326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:02.730778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:02.731268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:02.778386 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-adf38273-caac-493e-8be8-2a5e74290788 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] HTTP exception thrown: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-adf38273-caac-493e-8be8-2a5e74290788 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Request method failure captured: Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6 HTTP/1.1 Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kQ4120HIIsNEsDosiedSoQqBJd_PTp_rmB6GNZxeW80_H7MCt-GWzmm4Y74vv9GOmn5itXKoa17SmelUIPLCvQLSYQh7O_ELUUWj0_IFoN7G6eP9XCpR82c4-vICAKUTXxrtTMNDvC5c8the2qRNm3lFAfmmOCC61Bh3ScRQN-VEOs Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 6c60c68e5637481bba22ab515ee1698c Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:26:02.782923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6c60c68e5637481bba22ab515ee1698c", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 6c60c68e5637481bba22ab515ee1698c Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesSnapshotsTestJSON-698795590-project Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 22876106e28646eabfcfb43e191bccd7 Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesSnapshotsTestJSON-698795590-project Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '663bc8f1-3f61-4777-8132-5bcc5ed462a6'} Aug 09 11:26:02.784112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. (HTTP 404) (Request-ID: req-31776d62-1be5-45c6-8756-9dd59ecafd2d) Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:02.784923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:26:02.786122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 11:26:02.787521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:02.789489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:02.790626 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Getting quotas for project ec50a06edc0445e798202c786b37aa19. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:26:02.791724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-adf38273-caac-493e-8be8-2a5e74290788 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Returning 404 to user: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:02.793261 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-adf38273-caac-493e-8be8-2a5e74290788 tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6" status: 404 len: 109 microversion: 2.1 time: 0.088734 Aug 09 11:26:02.794328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 21/38] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:26:02 2022] DELETE /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:26:02.799842 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Getting quotas for user 00b3cd9e2c3e48c299037759cab9ccce and project ec50a06edc0445e798202c786b37aa19. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:26:02.803836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-00f92e97-1bb3-4234-a031-f99007f64be6 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece3269dc0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:02.826221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:26:02.831834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:26:02.969961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-00f92e97-1bb3-4234-a031-f99007f64be6 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.174289 Aug 09 11:26:02.971129 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 22/39] 10.222.0.59 () {58 vars in 1134 bytes} [Tue Aug 9 11:26:02 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:02.979607 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ca2e6e3a-2a18-4861-8a10-1f797a3d2f1c tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Calling method '.version_select at 0x7fece3269700>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:03.006228 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-268f295d-df42-4ffb-b237-7a93e638631a tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.615314 Aug 09 11:26:03.011176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 18/40] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:26:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:26:03.026151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1561294914", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:03.085251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-ca2e6e3a-2a18-4861-8a10-1f797a3d2f1c tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] HTTP exception thrown: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ca2e6e3a-2a18-4861-8a10-1f797a3d2f1c tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Request method failure captured: Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6 HTTP/1.1 Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kQ4120HIIsNEsDosiedSoQqBJd_PTp_rmB6GNZxeW80_H7MCt-GWzmm4Y74vv9GOmn5itXKoa17SmelUIPLCvQLSYQh7O_ELUUWj0_IFoN7G6eP9XCpR82c4-vICAKUTXxrtTMNDvC5c8the2qRNm3lFAfmmOCC61Bh3ScRQN-VEOs Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 6c60c68e5637481bba22ab515ee1698c Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:26:03.088054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6c60c68e5637481bba22ab515ee1698c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6c60c68e5637481bba22ab515ee1698c", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 6c60c68e5637481bba22ab515ee1698c Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-698795590 Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesSnapshotsTestJSON-698795590-project Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 22876106e28646eabfcfb43e191bccd7 Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesSnapshotsTestJSON-698795590-project Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '663bc8f1-3f61-4777-8132-5bcc5ed462a6'} Aug 09 11:26:03.089153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. (HTTP 404) (Request-ID: req-af3a4ddc-27c7-4aba-a489-92be8d639825) Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:03.089794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:26:03.091569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 11:26:03.092482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ca2e6e3a-2a18-4861-8a10-1f797a3d2f1c tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] Returning 404 to user: Volume 663bc8f1-3f61-4777-8132-5bcc5ed462a6 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ca2e6e3a-2a18-4861-8a10-1f797a3d2f1c tempest-VolumesSnapshotsTestJSON-698795590 tempest-VolumesSnapshotsTestJSON-698795590-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6" status: 404 len: 109 microversion: 2.1 time: 0.116852 Aug 09 11:26:03.093391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 23/41] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:26:02 2022] GET /compute/v2.1/os-volumes/663bc8f1-3f61-4777-8132-5bcc5ed462a6 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:26:03.119443 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0db9dff6-e0e3-48b3-a528-c83c5f29bce9 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece3278c10>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:03.212011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] validate_networks() for [('cada0da3-73dc-4829-967e-cf7277f4eed4', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:26:03.371128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0db9dff6-e0e3-48b3-a528-c83c5f29bce9 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.279195 Aug 09 11:26:03.371584 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 24/42] 10.222.0.59 () {58 vars in 1149 bytes} [Tue Aug 9 11:26:03 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:03.376510 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-efb2b36f-457b-4928-ace1-a596e293ba08 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:03.377291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-efb2b36f-457b-4928-ace1-a596e293ba08 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:03.493023 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-efb2b36f-457b-4928-ace1-a596e293ba08 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:03.501260 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-efb2b36f-457b-4928-ace1-a596e293ba08 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1213 microversion: 2.1 time: 0.128278 Aug 09 11:26:03.501832 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 25/43] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:03 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:03.543532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-baa82be1-ba0a-4196-8611-d58531570df6 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece327f160>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:03.719964 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-baa82be1-ba0a-4196-8611-d58531570df6 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.210521 Aug 09 11:26:03.720846 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 26/44] 10.222.0.59 () {58 vars in 1134 bytes} [Tue Aug 9 11:26:03 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:03.734221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e03c11a6-5bb0-44cb-8571-044d1f37bfb2 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece3274790>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:03.926121 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e03c11a6-5bb0-44cb-8571-044d1f37bfb2 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.195757 Aug 09 11:26:03.935205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 27/45] 10.222.0.59 () {58 vars in 1167 bytes} [Tue Aug 9 11:26:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:03.940599 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-18244b7a-38b9-4645-9935-022da5289e14 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece3ac59d0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:04.225412 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-18244b7a-38b9-4645-9935-022da5289e14 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.288348 Aug 09 11:26:04.235580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 28/46] 10.222.0.59 () {58 vars in 1170 bytes} [Tue Aug 9 11:26:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:04.245307 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a071810e-323b-4979-887c-4e16b5c41d2c tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece32745e0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:04.536081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a071810e-323b-4979-887c-4e16b5c41d2c tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.299170 Aug 09 11:26:04.544955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 29/47] 10.222.0.59 () {58 vars in 1155 bytes} [Tue Aug 9 11:26:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:04.551049 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-76385726", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f40c29ea-3de1-4291-8b2e-116412f586de"}], "security_groups": [{"name": "tempest-securitygroup--1306695171"}], "key_name": "tempest-keypair-644904299", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:04.951535 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] validate_networks() for [('f40c29ea-3de1-4291-8b2e-116412f586de', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:26:05.688722 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:26:05.689898 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:26:05.690503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:26:05.691163 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:26:05.691907 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:26:05.714722 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:05.719069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:05.719865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:05.721560 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:05.722269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:05.724512 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:05.785891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Getting quotas for project b0a6fd5299a7475bad7836d22b23967d. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:26:05.805907 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Getting quotas for user 8f9dc600fea34effa2afa8aee54aab7e and project b0a6fd5299a7475bad7836d22b23967d. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:26:05.854835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:26:05.860297 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:26:05.975372 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d800dcdc-26d3-49d7-b694-0522cf14aef2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.959700 Aug 09 11:26:05.978386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 19/48] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:26:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:26:05.987548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:05.989890 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:06.038316 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:06.043100 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:06.045025 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:06.046508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:06.048121 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:06.049093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:06.575568 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:26:06.576096 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:26:06.577850 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:26:06.581680 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:26:06.582376 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:26:06.609363 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:06.610266 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:06.613403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:06.614551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:06.615913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:06.619641 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:06.640680 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:06.673484 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b0b07c42-4acb-42ef-a50b-9f7ef1caa543 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1265 microversion: 2.1 time: 0.693666 Aug 09 11:26:06.695864 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 20/49] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:05 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1265 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:06.725867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-265f9d8e-463f-425b-8a4f-8576dfb413df tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece2a1ef70>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:06.749706 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:26:06.775080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for user 8512df3e232c4fd59b7abad4e6e05c9d and project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:26:06.860564 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:26:06.875134 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:26:07.166421 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0c7634c9-4db1-4ce0-aa43-f92ae6257089 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.619812 Aug 09 11:26:07.168971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 30/50] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:26:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:26:07.170353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-265f9d8e-463f-425b-8a4f-8576dfb413df tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.466419 Aug 09 11:26:07.171887 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 21/51] 10.222.0.59 () {58 vars in 1188 bytes} [Tue Aug 9 11:26:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:07.183679 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cbbe41d3-4335-4a2c-8d97-4716a8151b91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:07.184530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cbbe41d3-4335-4a2c-8d97-4716a8151b91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:07.190138 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a2955c30-3e1d-4380-a7d5-c814fba5e71c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:07.198965 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a2955c30-3e1d-4380-a7d5-c814fba5e71c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:07.474829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cbbe41d3-4335-4a2c-8d97-4716a8151b91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:07.503997 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cbbe41d3-4335-4a2c-8d97-4716a8151b91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1239 microversion: 2.1 time: 0.328871 Aug 09 11:26:07.521072 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 22/52] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:07 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1239 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:07.535755 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a5d6878e-14f0-432c-9e1b-9548aa889f48 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] Calling method '.version_select at 0x7fece29adca0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:07.596676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a2955c30-3e1d-4380-a7d5-c814fba5e71c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:07.617723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a2955c30-3e1d-4380-a7d5-c814fba5e71c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1222 microversion: 2.1 time: 0.445040 Aug 09 11:26:07.633293 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 31/53] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:07 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1222 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:07.729984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:07.730603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:07.750323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:07.751811 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:07.759990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:07.761036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:07.764907 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:07.767303 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:07.805385 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a5d6878e-14f0-432c-9e1b-9548aa889f48 tempest-VolumesTestJSON-22342729 tempest-VolumesTestJSON-22342729-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.283085 Aug 09 11:26:07.805956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 23/54] 10.222.0.59 () {58 vars in 1155 bytes} [Tue Aug 9 11:26:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:08.232824 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:08.260173 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7f1077ec-2b0f-4374-b266-85f2f1e82397 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1271 microversion: 2.1 time: 0.535022 Aug 09 11:26:08.271678 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 32/55] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:07 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1271 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:08.544036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:08.544910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:08.555000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:08.558019 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:08.561342 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:08.562375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:08.564364 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:08.565018 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:08.914296 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aa69fa0a-5bf5-47d7-a3ee-86da0bf294c1 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Action: 'create', calling method: .version_select at 0x7fece31fb8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-961887087", "metadata": {"Type": "work"}}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aa69fa0a-5bf5-47d7-a3ee-86da0bf294c1 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Request method failure captured: Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 121 Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRQfmdVm7Ud2GI52bsJ0HVmy_jyc2Q8dcucnhMVdqOtqj_L8gDoXleinaR6eF0FNPbL2VJlJUSMjzd_w3gYicPGmIcan8JPraKYG6AMbrV5-Pr6U7Rf1WDYnBZ6rgSMozUZF24vD-I7DwV0eCPjTEGKL2pBYpmoY7z8E5fXvw_kwDA Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:26:08.920270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e57121d25149469ca093abb33c9082f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e57121d25149469ca093abb33c9082f4", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 44cd0733cef0489997c52c3bc44e2a8c Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-961887087", "metadata": {"Type": "work"}}} Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: Aug 09 11:26:08.921479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-961887087', 'metadata': {'Type': 'work'}}}} Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise error Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:08.922202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 11:26:08.923403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 11:26:08.924442 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 11:26:08.924442 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:08.926892 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aa69fa0a-5bf5-47d7-a3ee-86da0bf294c1 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:08.928012 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aa69fa0a-5bf5-47d7-a3ee-86da0bf294c1 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.381413 Aug 09 11:26:08.935201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 33/56] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 9 11:26:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 389 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 11:26:08.941842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:08.942834 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:08.951238 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:08.952099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:08.952740 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:08.953664 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:08.954329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:08.954983 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:08.984828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:08.998917 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-108eac41-342e-4927-b4ae-0e2fc1a6ec61 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1243 microversion: 2.1 time: 0.459250 Aug 09 11:26:09.012336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 24/57] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:08 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1243 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:09.024683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6d4bba19-6426-433f-be00-98e105ce9dd1 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Action: 'create', calling method: .version_select at 0x7fece2a1e160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1230485852", "metadata": {"Type": "work"}}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6d4bba19-6426-433f-be00-98e105ce9dd1 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Request method failure captured: Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 120 Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRQfmdVm7Ud2GI52bsJ0HVmy_jyc2Q8dcucnhMVdqOtqj_L8gDoXleinaR6eF0FNPbL2VJlJUSMjzd_w3gYicPGmIcan8JPraKYG6AMbrV5-Pr6U7Rf1WDYnBZ6rgSMozUZF24vD-I7DwV0eCPjTEGKL2pBYpmoY7z8E5fXvw_kwDA Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:26:09.030237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e57121d25149469ca093abb33c9082f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e57121d25149469ca093abb33c9082f4", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 44cd0733cef0489997c52c3bc44e2a8c Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1230485852", "metadata": {"Type": "work"}}} Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: Aug 09 11:26:09.031747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1230485852', 'metadata': {'Type': 'work'}}}} Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise error Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi '0' Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:09.032403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 11:26:09.033522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 11:26:09.034416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 11:26:09.034416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.034416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6d4bba19-6426-433f-be00-98e105ce9dd1 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:09.034416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6d4bba19-6426-433f-be00-98e105ce9dd1 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019147 Aug 09 11:26:09.034416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 25/58] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 9 11:26:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:26:09.044945 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c1690618-783f-4506-8e8e-568efad8ef35 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Action: 'create', calling method: .version_select at 0x7fece2968790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-129183456", "metadata": {"Type": "work"}}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c1690618-783f-4506-8e8e-568efad8ef35 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Request method failure captured: Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 118 Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRQfmdVm7Ud2GI52bsJ0HVmy_jyc2Q8dcucnhMVdqOtqj_L8gDoXleinaR6eF0FNPbL2VJlJUSMjzd_w3gYicPGmIcan8JPraKYG6AMbrV5-Pr6U7Rf1WDYnBZ6rgSMozUZF24vD-I7DwV0eCPjTEGKL2pBYpmoY7z8E5fXvw_kwDA Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:26:09.049099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e57121d25149469ca093abb33c9082f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e57121d25149469ca093abb33c9082f4", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 44cd0733cef0489997c52c3bc44e2a8c Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-129183456", "metadata": {"Type": "work"}}} Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: Aug 09 11:26:09.050281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-129183456', 'metadata': {'Type': 'work'}}}} Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise error Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi '' Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:09.051057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 11:26:09.052247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 11:26:09.053492 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 11:26:09.053492 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.055304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c1690618-783f-4506-8e8e-568efad8ef35 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:09.056501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c1690618-783f-4506-8e8e-568efad8ef35 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017570 Aug 09 11:26:09.057899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 26/59] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 9 11:26:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:26:09.060995 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:09.069537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1eb32767-a3eb-489b-b124-b3ed9156b471 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1226 microversion: 2.1 time: 0.132664 Aug 09 11:26:09.069889 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-944d41c0-a625-449a-a55d-621b73d7a801 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Calling method '.version_select at 0x7fece2968a60>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:09.073976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 34/60] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:08 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1226 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:09.118915 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-944d41c0-a625-449a-a55d-621b73d7a801 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] HTTP exception thrown: Volume tempest-invalid-732117968 could not be found. Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-944d41c0-a625-449a-a55d-621b73d7a801 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Request method failure captured: Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-732117968 HTTP/1.1 Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRQfmdVm7Ud2GI52bsJ0HVmy_jyc2Q8dcucnhMVdqOtqj_L8gDoXleinaR6eF0FNPbL2VJlJUSMjzd_w3gYicPGmIcan8JPraKYG6AMbrV5-Pr6U7Rf1WDYnBZ6rgSMozUZF24vD-I7DwV0eCPjTEGKL2pBYpmoY7z8E5fXvw_kwDA Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:26:09.121243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e57121d25149469ca093abb33c9082f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e57121d25149469ca093abb33c9082f4", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 44cd0733cef0489997c52c3bc44e2a8c Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Volume tempest-invalid-732117968 could not be found. Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'tempest-invalid-732117968'} Aug 09 11:26:09.122705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-732117968 could not be found. (HTTP 404) (Request-ID: req-114623ea-1b3e-400c-a965-0ee53e61f432) Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.123612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:26:09.124876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-732117968 could not be found. Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:26:09.125950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-732117968 could not be found. Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-732117968 could not be found. Aug 09 11:26:09.127270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.129892 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-944d41c0-a625-449a-a55d-621b73d7a801 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Returning 404 to user: Volume tempest-invalid-732117968 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:09.131048 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-944d41c0-a625-449a-a55d-621b73d7a801 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-732117968" status: 404 len: 98 microversion: 2.1 time: 0.067294 Aug 09 11:26:09.132095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 27/61] 10.222.0.59 () {58 vars in 1215 bytes} [Tue Aug 9 11:26:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-732117968 => generated 98 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 09 11:26:09.143261 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e529f7df-bfd0-4a06-bd7d-00659d18e01e tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004290 Aug 09 11:26:09.143877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 35/62] 10.222.0.59 () {58 vars in 1140 bytes} [Tue Aug 9 11:26:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 11:26:09.154459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b7635c5c-50a6-4fd9-b0cd-bf8fee79e04c tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004123 Aug 09 11:26:09.156758 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 28/63] 10.222.0.59 () {58 vars in 1137 bytes} [Tue Aug 9 11:26:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 11:26:09.166930 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1e0cbcba-d654-4871-9931-9be2fc4c2d38 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Calling method '.version_select at 0x7fece3206310>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:09.248772 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-1e0cbcba-d654-4871-9931-9be2fc4c2d38 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] HTTP exception thrown: Volume 15d4b214-f958-4f1a-95e1-9a2c3af01d61 could not be found. Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1e0cbcba-d654-4871-9931-9be2fc4c2d38 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Request method failure captured: Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/os-volumes/15d4b214-f958-4f1a-95e1-9a2c3af01d61 HTTP/1.1 Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRQfmdVm7Ud2GI52bsJ0HVmy_jyc2Q8dcucnhMVdqOtqj_L8gDoXleinaR6eF0FNPbL2VJlJUSMjzd_w3gYicPGmIcan8JPraKYG6AMbrV5-Pr6U7Rf1WDYnBZ6rgSMozUZF24vD-I7DwV0eCPjTEGKL2pBYpmoY7z8E5fXvw_kwDA Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:26:09.250736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e57121d25149469ca093abb33c9082f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e57121d25149469ca093abb33c9082f4", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 44cd0733cef0489997c52c3bc44e2a8c Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Volume 15d4b214-f958-4f1a-95e1-9a2c3af01d61 could not be found. Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '15d4b214-f958-4f1a-95e1-9a2c3af01d61'} Aug 09 11:26:09.253947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15d4b214-f958-4f1a-95e1-9a2c3af01d61 could not be found. (HTTP 404) (Request-ID: req-135ee31e-be9c-49e2-8acb-720e1ecb1632) Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.254720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 11:26:09.255694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15d4b214-f958-4f1a-95e1-9a2c3af01d61 could not be found. Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 11:26:09.256808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15d4b214-f958-4f1a-95e1-9a2c3af01d61 could not be found. Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15d4b214-f958-4f1a-95e1-9a2c3af01d61 could not be found. Aug 09 11:26:09.257960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.261152 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1e0cbcba-d654-4871-9931-9be2fc4c2d38 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Returning 404 to user: Volume 15d4b214-f958-4f1a-95e1-9a2c3af01d61 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:09.261152 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1e0cbcba-d654-4871-9931-9be2fc4c2d38 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/15d4b214-f958-4f1a-95e1-9a2c3af01d61" status: 404 len: 109 microversion: 2.1 time: 0.098798 Aug 09 11:26:09.261152 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 36/64] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:26:09 2022] DELETE /compute/v2.1/os-volumes/15d4b214-f958-4f1a-95e1-9a2c3af01d61 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:26:09.279592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d399756e-0dc2-4d3a-bda6-3680a66301c6 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Calling method '.version_select at 0x7fece29d3670>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:09.303674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:09.305898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:09.343816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:09.344319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:09.348889 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:09.350417 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:09.350932 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:09.352450 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:09.362685 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-d399756e-0dc2-4d3a-bda6-3680a66301c6 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] HTTP exception thrown: Volume ca0b9d2b-8670-42ac-9e47-770f2ea12155 could not be found. Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d399756e-0dc2-4d3a-bda6-3680a66301c6 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Request method failure captured: Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/os-volumes/ca0b9d2b-8670-42ac-9e47-770f2ea12155 HTTP/1.1 Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRQfmdVm7Ud2GI52bsJ0HVmy_jyc2Q8dcucnhMVdqOtqj_L8gDoXleinaR6eF0FNPbL2VJlJUSMjzd_w3gYicPGmIcan8JPraKYG6AMbrV5-Pr6U7Rf1WDYnBZ6rgSMozUZF24vD-I7DwV0eCPjTEGKL2pBYpmoY7z8E5fXvw_kwDA Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:26:09.365336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e57121d25149469ca093abb33c9082f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e57121d25149469ca093abb33c9082f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e57121d25149469ca093abb33c9082f4", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: e57121d25149469ca093abb33c9082f4 Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesNegativeTest-1968675567 Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 44cd0733cef0489997c52c3bc44e2a8c Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesNegativeTest-1968675567-project Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Volume ca0b9d2b-8670-42ac-9e47-770f2ea12155 could not be found. Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'ca0b9d2b-8670-42ac-9e47-770f2ea12155'} Aug 09 11:26:09.366477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca0b9d2b-8670-42ac-9e47-770f2ea12155 could not be found. (HTTP 404) (Request-ID: req-a903bc11-8513-4ea2-99f6-a7735052428b) Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.367209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 11:26:09.368157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca0b9d2b-8670-42ac-9e47-770f2ea12155 could not be found. Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 11:26:09.369135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca0b9d2b-8670-42ac-9e47-770f2ea12155 could not be found. Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca0b9d2b-8670-42ac-9e47-770f2ea12155 could not be found. Aug 09 11:26:09.370166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:26:09.372739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d399756e-0dc2-4d3a-bda6-3680a66301c6 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] Returning 404 to user: Volume ca0b9d2b-8670-42ac-9e47-770f2ea12155 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:26:09.373883 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d399756e-0dc2-4d3a-bda6-3680a66301c6 tempest-VolumesNegativeTest-1968675567 tempest-VolumesNegativeTest-1968675567-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca0b9d2b-8670-42ac-9e47-770f2ea12155" status: 404 len: 109 microversion: 2.1 time: 0.106899 Aug 09 11:26:09.375361 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 29/65] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 11:26:09 2022] GET /compute/v2.1/os-volumes/ca0b9d2b-8670-42ac-9e47-770f2ea12155 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:26:09.844601 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:09.855224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-86ba3751-356c-41f0-ab9a-3b8f144e7d75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.571832 Aug 09 11:26:09.855801 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 37/66] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:09 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:10.023964 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:10.024684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:10.038389 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.039779 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.041519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:10.043059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.043862 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.044520 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:10.096013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:10.097273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:10.104023 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.104490 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.105201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:10.106108 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.106639 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.107295 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:10.144489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:10.155241 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b6dce977-9682-4685-8114-28c2d05fc4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1243 microversion: 2.1 time: 0.134633 Aug 09 11:26:10.159641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 30/67] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:10 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1243 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:10.192361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:10.201260 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ffe7bb23-1ab3-40b9-ae33-25c7098341be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1226 microversion: 2.1 time: 0.110228 Aug 09 11:26:10.202468 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 38/68] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:10 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:10.876054 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:10.876681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:10.887120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.896197 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.896659 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:10.897429 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:10.897895 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:10.898328 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:11.181892 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:11.183859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:11.199141 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:11.200247 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:11.205391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:11.209047 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:11.210453 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:11.212223 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:11.504541 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:11.528074 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fc058a40-73f4-46f3-9d78-0bf57f9c6387 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1243 microversion: 2.1 time: 0.350866 Aug 09 11:26:11.529316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 39/69] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:11 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1243 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:11.548732 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:11.550353 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:11.562479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:11.563042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:11.563487 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:11.564206 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:11.570234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:11.571622 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:11.572080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:11.582792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2b04e10c-ac9d-43af-98c5-96cc50ec1c4b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.711038 Aug 09 11:26:11.585893 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 31/70] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:10 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:11.755722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:11.776826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d566c0d0-f4be-4228-8c10-d8b74ab1fc93 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1218 microversion: 2.1 time: 0.246132 Aug 09 11:26:11.777919 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 40/71] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:11 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:12.550261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:12.551539 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:12.567615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:12.568983 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:12.571650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:12.577117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:12.577849 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:12.578745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:12.607821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:12.609320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:12.619941 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:12.633771 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:12.634399 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:12.637062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:12.639121 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:12.640150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:12.929016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:12.938680 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-269d66c2-e4e4-47cd-b683-e3f88f9d6561 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1309 microversion: 2.1 time: 0.392827 Aug 09 11:26:12.964998 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 32/72] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:12 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1309 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:12.980008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:12.983389 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:13.010310 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:13.012959 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:13.015068 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:13.016118 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:13.018783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:13.026373 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:13.299422 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:13.319046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c4226eee-adc5-4377-9bb8-3d620f078dd4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1280 microversion: 2.1 time: 0.349690 Aug 09 11:26:13.323618 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 33/73] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:12 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1280 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:13.465490 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:13.475621 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5497fbb9-8d87-442d-a85a-7ccf2734cd16 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.871695 Aug 09 11:26:13.479572 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 41/74] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:12 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:13.972062 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:13.975420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:13.996932 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:13.997808 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:13.998419 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:13.999420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:14.000029 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:14.000636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:14.198613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:14.211383 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c0024f16-df2c-43ec-8cd7-c0b7e976d2fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1297 microversion: 2.1 time: 0.243039 Aug 09 11:26:14.223699 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 34/75] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:13 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1297 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:14.344833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:14.346169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:14.360522 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:14.364578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:14.365481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:14.366473 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:14.369627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:14.371323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:14.506788 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:14.513293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:14.571796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:14.579333 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:14.584374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:14.586852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:14.594673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:14.595587 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:14.803465 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:14.826622 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-871daf66-d533-4311-92a9-867559057fa7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1280 microversion: 2.1 time: 0.473880 Aug 09 11:26:14.828945 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 42/76] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:14 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1280 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:15.264729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:15.264729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:15.264729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:15.264729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:15.265275 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:15.265275 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:15.265275 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:15.265275 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:15.750063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:15.894882 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:15.907866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-01d54fa9-b6bd-46b8-ad48-0bab99ed38dc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 1.408651 Aug 09 11:26:15.908460 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 35/77] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:14 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:16.102802 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:16.116712 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d96a7cc8-4ec2-4610-a5b4-3e09d83048c3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.871039 Aug 09 11:26:16.117305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 43/78] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:15 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:16.134694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:16.135460 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:16.143972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:16.144708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:16.145256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:16.145988 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:16.146600 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:16.147081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:16.273534 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:16.307323 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-7831f7cd-ac92-465b-bdb8-363818aff54c req-c986b581-c799-4e3d-b96d-50d7f722bfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aee6415-5779-4bbf-8f4d-f715e7584dab", "tag": "6ff70cac-30d2-42c4-b021-e07e78195636"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:16.322502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6caba9e1-4963-4247-a0b0-ac802f728af4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1280 microversion: 2.1 time: 0.199183 Aug 09 11:26:16.325997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 44/79] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:16 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:16.342649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7831f7cd-ac92-465b-bdb8-363818aff54c req-c986b581-c799-4e3d-b96d-50d7f722bfe9 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:16.343549 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7831f7cd-ac92-465b-bdb8-363818aff54c req-c986b581-c799-4e3d-b96d-50d7f722bfe9 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:16.344757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7831f7cd-ac92-465b-bdb8-363818aff54c req-c986b581-c799-4e3d-b96d-50d7f722bfe9 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:16.387137 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-7831f7cd-ac92-465b-bdb8-363818aff54c req-c986b581-c799-4e3d-b96d-50d7f722bfe9 service nova] Creating event network-changed:6ff70cac-30d2-42c4-b021-e07e78195636 for instance 7aee6415-5779-4bbf-8f4d-f715e7584dab on hv-cinder-84989 Aug 09 11:26:16.388400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7831f7cd-ac92-465b-bdb8-363818aff54c req-c986b581-c799-4e3d-b96d-50d7f722bfe9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117792) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 11:26:16.389307 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7831f7cd-ac92-465b-bdb8-363818aff54c req-c986b581-c799-4e3d-b96d-50d7f722bfe9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117792) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 11:26:16.392121 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79931d34-3c71-416e-85fc-99e1badade1a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:16.393172 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79931d34-3c71-416e-85fc-99e1badade1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:16.394876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79931d34-3c71-416e-85fc-99e1badade1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:16.396587 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79931d34-3c71-416e-85fc-99e1badade1a None None] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:16.397645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79931d34-3c71-416e-85fc-99e1badade1a None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:16.400309 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79931d34-3c71-416e-85fc-99e1badade1a None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:16.457124 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.compute.rpcapi [None req-79931d34-3c71-416e-85fc-99e1badade1a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 11:26:16.462966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-79931d34-3c71-416e-85fc-99e1badade1a None None] Releasing lock "compute-rpcapi-router" {{(pid=117792) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 11:26:16.521761 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-79931d34-3c71-416e-85fc-99e1badade1a None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.611809 Aug 09 11:26:16.523208 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 36/80] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:16.937858 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:16.938469 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:16.941362 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:16.951416 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:16.952992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:16.954062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:16.955257 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:16.956544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:16.957226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:17.204703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-477e9176-7b82-489a-8aa6-bf5d1cd6991d req-55fa5bce-7c22-4e00-9aae-511d11d6d8ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f727a3f9-56c8-4305-bcd5-68f8d6d31f79", "tag": "2f3704c5-212e-4b8b-b7e6-10d9252525b6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:17.215581 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-477e9176-7b82-489a-8aa6-bf5d1cd6991d req-55fa5bce-7c22-4e00-9aae-511d11d6d8ac service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:17.216135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-477e9176-7b82-489a-8aa6-bf5d1cd6991d req-55fa5bce-7c22-4e00-9aae-511d11d6d8ac service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:17.216654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-477e9176-7b82-489a-8aa6-bf5d1cd6991d req-55fa5bce-7c22-4e00-9aae-511d11d6d8ac service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:17.229834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-477e9176-7b82-489a-8aa6-bf5d1cd6991d req-55fa5bce-7c22-4e00-9aae-511d11d6d8ac service nova] Creating event network-changed:2f3704c5-212e-4b8b-b7e6-10d9252525b6 for instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 on hv-cinder-84989 Aug 09 11:26:17.236271 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-477e9176-7b82-489a-8aa6-bf5d1cd6991d req-55fa5bce-7c22-4e00-9aae-511d11d6d8ac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120936 Aug 09 11:26:17.238721 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 37/81] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:26:17.244617 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:17.245279 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:17.252101 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:17.252794 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:17.253389 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:17.254193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:17.254743 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:17.255485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:17.346709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:17.355942 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-443f1fc2-68fb-4a86-b410-181b55212b1c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.421902 Aug 09 11:26:17.357150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 45/82] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:16 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:17.375672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:17.376297 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:17.383628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:17.384164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:17.384998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:17.385970 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:17.386612 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:17.387238 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:17.489466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=18 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:17.525082 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:17.541708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a1f213c9-1045-459c-8374-031635b69a52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.294493 Aug 09 11:26:17.541708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 38/83] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:17 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:17.593036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:17.604818 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0b4d2161-213e-4dfb-aad4-6de7f5c9dd52 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.245848 Aug 09 11:26:17.605769 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 46/84] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:17 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:18.383688 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:18.385701 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:18.397274 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:18.398132 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:18.398941 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:18.400198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:18.401166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:18.401927 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:18.560377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:18.560912 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:18.563905 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=18 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:18.572145 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:18.572641 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:18.573071 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:18.573768 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:18.575455 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:18.576028 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:18.594970 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:18.604202 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f37a15eb-ca68-418b-8eac-f95fa9ab7549 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.227834 Aug 09 11:26:18.607234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 39/85] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:18 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:18.626121 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:18.627011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:18.633977 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:18.634731 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:18.635400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:18.636506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:18.637117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:18.637688 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:18.791793 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:18.801211 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5954865c-b2fe-44c6-b322-e13f17cff1bc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.245351 Aug 09 11:26:18.803239 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 47/86] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:18 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:18.844970 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:18.856165 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9e330b1d-ef9a-4628-b4ef-a6153cbd0cac tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.233784 Aug 09 11:26:18.857169 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 40/87] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:18 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:19.627928 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:19.628796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:19.639856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:19.640334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:19.640772 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:19.641509 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:19.642135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:19.660899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:19.839940 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:19.840721 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:19.855068 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:19.865146 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:19.867178 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:19.867966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:19.868451 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:19.868878 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:20.007201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:20.020116 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-67b51476-46c2-475d-bf72-d470028b7026 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.397109 Aug 09 11:26:20.033242 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 48/88] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:19 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:20.039177 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:20.040163 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:20.047365 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:20.048164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:20.048794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:20.049681 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:20.050432 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:20.051198 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:20.276458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:20.291857 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7fb1e20f-a388-44cf-aac8-ae6fe3b4f5dc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.466594 Aug 09 11:26:20.292730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 41/89] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:19 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:20.353098 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:20.384082 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-abd405df-e2f7-424d-9bfd-f60d2f8248af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.340249 Aug 09 11:26:20.384882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 49/90] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:20 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:21.069528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:21.070478 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:21.083937 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:21.084447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:21.087538 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:21.088655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:21.089708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:21.090343 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:21.329634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:21.330548 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:21.363006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:21.364244 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:21.365197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:21.367560 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:21.385780 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:21.388508 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:22.941863 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:22.946036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:22.958783 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f465ced6-9d07-4fa7-8c14-1b1df2b29781 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 1.632911 Aug 09 11:26:22.960880 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 50/91] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:21 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:22.980175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:22.982101 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:22.990332 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:23.008446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:23.009030 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:23.010187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:23.013251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:23.013715 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:23.015076 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:23.034309 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-01af3b44-891b-46c8-a574-3c98bfc12a3b tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 1.975752 Aug 09 11:26:23.042619 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 42/92] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:21 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:23.552544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:23.566965 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3808d4f4-d029-48c0-93ab-6e72ac8a6cba tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.603076 Aug 09 11:26:23.570490 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 51/93] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:22 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:23.983813 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:23.987109 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:23.999283 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.000019 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.001199 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.015516 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.016303 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.016899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.084336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:24.100203 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:24.159283 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.161232 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.162109 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.163605 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.166035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.167833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.629473 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:24.644920 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8c5c3643-ef66-4346-a9c1-50d1c2f2ce93 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.664687 Aug 09 11:26:24.648059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:24.650051 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 43/94] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:23 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:24.677826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ccee4983-4522-4b30-8cf9-a61f2274abf0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.613749 Aug 09 11:26:24.679131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 52/95] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:24 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:24.688670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-7f2c1003-1c94-4de1-9a84-b2d8658ff133 req-cfffbeb2-1aee-4053-9875-0b033019d750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a396c8a-da73-40f4-b239-d344970cdbcd", "tag": "c02f7ff1-bbb1-4b12-b948-d5b92e1df60a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:24.691999 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-173f1c99-325b-4997-9b0a-8d714e1518ae req-773e3a95-14bb-4b7f-b312-372409b27fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47718566-e01b-41e5-bdc1-ba691dc04c2c", "tag": "a4cec858-ffac-4590-8c8f-19f2d2926a37"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:24.706302 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-173f1c99-325b-4997-9b0a-8d714e1518ae req-773e3a95-14bb-4b7f-b312-372409b27fd1 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.707159 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-173f1c99-325b-4997-9b0a-8d714e1518ae req-773e3a95-14bb-4b7f-b312-372409b27fd1 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.708108 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-173f1c99-325b-4997-9b0a-8d714e1518ae req-773e3a95-14bb-4b7f-b312-372409b27fd1 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.715469 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7f2c1003-1c94-4de1-9a84-b2d8658ff133 req-cfffbeb2-1aee-4053-9875-0b033019d750 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.715469 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7f2c1003-1c94-4de1-9a84-b2d8658ff133 req-cfffbeb2-1aee-4053-9875-0b033019d750 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.715469 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7f2c1003-1c94-4de1-9a84-b2d8658ff133 req-cfffbeb2-1aee-4053-9875-0b033019d750 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.739990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-173f1c99-325b-4997-9b0a-8d714e1518ae req-773e3a95-14bb-4b7f-b312-372409b27fd1 service nova] Creating event network-changed:a4cec858-ffac-4590-8c8f-19f2d2926a37 for instance 47718566-e01b-41e5-bdc1-ba691dc04c2c on hv-cinder-84989 Aug 09 11:26:24.740899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-173f1c99-325b-4997-9b0a-8d714e1518ae req-773e3a95-14bb-4b7f-b312-372409b27fd1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 11:26:24.741495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-173f1c99-325b-4997-9b0a-8d714e1518ae req-773e3a95-14bb-4b7f-b312-372409b27fd1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 11:26:24.742844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-194ea22c-1264-43a9-bae3-ccc02dff32ca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.743526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-194ea22c-1264-43a9-bae3-ccc02dff32ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.744158 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-194ea22c-1264-43a9-bae3-ccc02dff32ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.745090 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-194ea22c-1264-43a9-bae3-ccc02dff32ca None None] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.745747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-194ea22c-1264-43a9-bae3-ccc02dff32ca None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.746436 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-194ea22c-1264-43a9-bae3-ccc02dff32ca None None] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.747217 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-7f2c1003-1c94-4de1-9a84-b2d8658ff133 req-cfffbeb2-1aee-4053-9875-0b033019d750 service nova] Creating event network-changed:c02f7ff1-bbb1-4b12-b948-d5b92e1df60a for instance 5a396c8a-da73-40f4-b239-d344970cdbcd on hv-cinder-84989 Aug 09 11:26:24.758748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.compute.rpcapi [None req-194ea22c-1264-43a9-bae3-ccc02dff32ca None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 11:26:24.760640 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-194ea22c-1264-43a9-bae3-ccc02dff32ca None None] Releasing lock "compute-rpcapi-router" {{(pid=117793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 11:26:24.763066 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-7f2c1003-1c94-4de1-9a84-b2d8658ff133 req-cfffbeb2-1aee-4053-9875-0b033019d750 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109704 Aug 09 11:26:24.763809 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 44/96] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:24.782431 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:24.783173 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:24.794131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-194ea22c-1264-43a9-bae3-ccc02dff32ca None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112365 Aug 09 11:26:24.794847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 53/97] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:24.795649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.798002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.798677 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.799846 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:24.800579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:24.801022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:24.830906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:24.994912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:25.004323 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7589fb4a-2d8f-40e4-a7c3-7077b91b6402 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.234253 Aug 09 11:26:25.006262 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 45/98] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:24 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:25.678633 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:25.681036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:25.683614 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:25.693200 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:25.694078 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:25.695885 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:25.696543 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:25.697044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:25.697468 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:25.702981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:25.703609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:25.710128 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:25.710622 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:25.711111 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:25.711780 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:25.717113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:25.717707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:25.921563 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:25.929717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f2078f2d-dd2b-4058-b1a6-653889d44478 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.230405 Aug 09 11:26:25.930524 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 46/99] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:25 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:25.973811 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:25.992355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e91cd086-f7de-4771-b4aa-0d29fc42a6f4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.321914 Aug 09 11:26:25.995828 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 54/100] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:25 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:26.026259 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:26.026690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:26.032986 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:26.033568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:26.034066 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:26.035130 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:26.035745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:26.036331 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:26.184434 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:26.192103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e5665148-5df7-4149-be4d-86248dc504a2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.169966 Aug 09 11:26:26.203149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 47/101] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:26 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:26.953761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:26.954365 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:26.961893 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:26.962467 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:26.963007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:26.963776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:26.964436 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:26.965006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:27.017105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:27.017761 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:27.025388 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:27.026566 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:27.039155 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:27.041514 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:27.042339 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:27.044010 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:27.044867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:27.046376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:27.211723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:27.221167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4a34a5d5-48aa-4c78-97f3-b8a7943206ba tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.271794 Aug 09 11:26:27.222186 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 55/102] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:26 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:27.230856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:27.231983 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:27.244297 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:27.246044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:27.247091 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:27.248582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:27.250416 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:27.251311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:27.374333 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:27.383392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-87b3a3a8-53aa-4145-802f-119d3789d4ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.370292 Aug 09 11:26:27.400323 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 48/103] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:27 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:27.468831 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:27.484944 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-482aaa91-47cc-4d2f-9e62-eafb69584442 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.260895 Aug 09 11:26:27.485684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 56/104] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:27 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:28.263846 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:28.270781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:28.277965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:28.278693 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:28.279227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:28.280162 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:28.286723 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:28.286723 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:28.413702 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:28.417575 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:28.428905 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:28.429498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:28.430725 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:28.432875 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:28.433520 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:28.434141 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:28.571637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:28.580242 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f5aa79b8-5e79-443f-918f-7a58d7d2fbbc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.324656 Aug 09 11:26:28.580841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 49/105] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:28 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:28.585967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:28.587002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:28.594782 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:28.595320 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:28.595771 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:28.596964 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:28.597521 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:28.598028 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:28.621064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:28.630422 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4ce69196-4a75-4dfc-b335-571034e7e455 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.222336 Aug 09 11:26:28.631268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 57/106] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:28 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:28.770335 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:28.784244 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-15cddbe3-ad23-479a-a7b2-9ce4a730b342 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.202101 Aug 09 11:26:28.798707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 50/107] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:28 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:29.603199 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:29.604182 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:29.626481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:29.629977 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:29.630502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:29.631724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:29.632654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:29.633221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:29.662625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:29.663274 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:29.676452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:29.676452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:29.676452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:29.681716 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:29.684493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:29.684945 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:30.074762 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:30.095625 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fdc694bc-2ec7-4840-9650-63080bb576d5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.495988 Aug 09 11:26:30.097984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 58/108] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:29 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:30.100942 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:30.116131 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1950ada4-ae3c-421f-b184-e6838e7166ee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.455829 Aug 09 11:26:30.116890 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:30.117859 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 51/109] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:29 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:30.119227 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:30.134989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:30.136010 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:30.137766 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:30.138864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:30.139423 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:30.143045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:30.467604 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:30.490216 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9b12e403-ae70-4fa9-a698-cd340dad2486 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.389469 Aug 09 11:26:30.491627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 59/110] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:30 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:31.124010 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:31.126660 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:31.140033 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:31.141333 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:31.150939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:31.151723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:31.152405 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:31.153280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:31.154174 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:31.154748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:31.162570 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:31.163044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:31.163487 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:31.164213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:31.164671 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:31.165135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:31.801151 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:31.811217 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:31.811657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5968b9db-f7ae-4d82-a8ea-fc3df83fec52 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.675281 Aug 09 11:26:31.812272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 60/111] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:31 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:31.823334 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bdabcbbd-84d9-4e77-a278-9b959b297bb3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.707411 Aug 09 11:26:31.825043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 52/112] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:31 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:31.833813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:31.836870 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:31.870943 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:31.873753 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:31.876797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:31.877778 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:31.878455 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:31.879335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:32.089049 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:32.105955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9fcfff2e-ca13-400a-8f08-e885df89fdef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.290427 Aug 09 11:26:32.107342 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 61/113] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:31 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:32.839000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:32.839985 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:32.850844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:32.851478 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:32.862464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:32.863254 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:32.863852 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:32.864743 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:32.865493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:32.866078 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:32.875706 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:32.876489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:32.877076 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:32.882347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:32.882870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:32.883314 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:33.203967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:33.207566 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:33.213870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-97d8e980-44a8-4e05-accc-328cb1f68ffd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.382244 Aug 09 11:26:33.214638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 53/114] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:32 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:33.223006 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:33.223819 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:33.227128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-76ff28c6-5e7f-47f3-bf6e-880084ac2e55 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.381257 Aug 09 11:26:33.227888 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 62/115] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:32 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:33.234015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:33.234504 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:33.239774 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:33.240891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:33.241778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:33.242372 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:33.399973 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:33.410573 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c3dcd7d2-6ee0-40e5-83f2-ecfef358f5ee tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.194541 Aug 09 11:26:33.413549 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 54/116] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:33 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:34.239509 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:34.240642 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:34.248164 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:34.249474 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:34.249982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:34.250377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:34.250495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:34.251157 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:34.251614 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:34.252038 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:34.258569 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:34.259434 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:34.259952 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:34.260887 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:34.261403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:34.262031 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:34.459021 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:34.468412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:34.471463 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7da793b6-9348-4133-8d66-27de76bac48e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.238224 Aug 09 11:26:34.472431 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 63/117] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:34 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:34.479276 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:34.480188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:34.489466 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:34.489966 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:34.490447 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:34.491215 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:34.491663 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:34.492263 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:34.494654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e8f67ec4-b192-41f6-9ba9-d8fa075c9150 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.250171 Aug 09 11:26:34.496051 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 55/118] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:34 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:34.690163 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:34.699923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b55376b7-f4ef-4436-ab8b-aa002ff893ce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.225734 Aug 09 11:26:34.700782 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 64/119] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:34 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:35.494836 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:35.495790 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:35.502978 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:35.503442 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:35.503871 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:35.504579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:35.505029 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:35.505449 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:35.529565 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:35.530757 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:35.552693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:35.557289 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:35.564211 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:35.568337 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:35.570005 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:35.571172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:35.574889 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:35.797756 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:35.811423 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3444d2cd-61e1-436f-afd6-d4c3a9b46c27 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.320765 Aug 09 11:26:35.812584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 56/120] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:35 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:35.822987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:35.822987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:35.834137 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:35.835010 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:35.835802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:35.837111 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:35.837400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:35.837912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:35.838644 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:35.847532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9012a7e7-eff6-495b-bdf2-e9ef6070e35d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.330223 Aug 09 11:26:35.848254 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 65/121] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:35 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:35.999759 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:36.007956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-00270d0a-f54b-4de7-bf67-3c0658e67fa0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.193810 Aug 09 11:26:36.008609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 57/122] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:35 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:36.839506 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:36.840335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:36.847650 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:36.848145 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:36.848618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:36.849912 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:36.850368 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:36.850789 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:36.871819 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:36.872776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:36.880083 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:36.880495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:36.880939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:36.881655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:36.882112 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:36.882535 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:37.260886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:37.264858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:37.269708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-43d06196-8019-4d56-88b4-8d31b127996b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.434656 Aug 09 11:26:37.270308 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 66/123] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:36 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:37.275063 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:37.275684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:37.281703 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:37.282187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:37.282629 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:37.283360 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:37.283819 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:37.284278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:37.288638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-54309059-d328-4060-b2dd-6fa03f630633 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.420979 Aug 09 11:26:37.289272 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 58/124] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:36 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:37.433559 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:37.437077 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:37.444938 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-71844d4d-1d50-4538-9b70-41f91c60a051 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.172765 Aug 09 11:26:37.445924 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 67/125] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:37 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:38.293825 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:38.294456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:38.301810 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:38.302394 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:38.302909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:38.303654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:38.304133 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:38.304560 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:38.313722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:38.315165 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:38.325607 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:38.326300 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:38.326885 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:38.327612 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:38.328070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:38.328529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:38.539632 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:38.551763 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-636453ea-4e12-4bbb-8f38-e4d5ef639c7a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.261546 Aug 09 11:26:38.552617 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 59/126] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:38 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:38.566589 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:38.567298 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:38.574132 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:38.575296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:38.575787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:38.576252 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:38.576947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:38.577393 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:38.577808 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:38.581991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-169cdd00-5fbc-4825-b470-a3209d7bd774 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.274278 Aug 09 11:26:38.582536 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 68/127] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:38 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:38.724878 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:38.734253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-31926888-70c5-49c0-a0c2-533dbea76dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.173052 Aug 09 11:26:38.735017 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 60/128] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:38 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:39.575153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:39.579080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:39.593143 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:39.594081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:39.594580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:39.595441 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:39.595997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:39.598011 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:39.604416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:39.605422 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:39.614910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:39.616683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:39.617350 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:39.618506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:39.621904 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:39.624071 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:40.140886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:40.147962 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:40.149827 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e0f97de6-8aa7-4670-9b18-c901ef5fdaf3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.580134 Aug 09 11:26:40.150433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 69/129] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:39 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:40.156125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:40.156799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:40.163192 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3c919da2-79a1-4b8f-ada6-64bcd61012fc tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.562747 Aug 09 11:26:40.163621 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:40.164123 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:40.164563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:40.165281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:40.165746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 61/130] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:39 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:40.165913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:40.166242 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:40.330596 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:40.343384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c456c1d8-d39d-409b-9768-07ae7daff0fc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.191227 Aug 09 11:26:40.344402 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 70/131] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:40 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:41.173799 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:41.175899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:41.189603 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:41.191419 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:41.192104 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:41.193199 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:41.194150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:41.194868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:41.202575 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:41.206745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:41.207722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:41.217591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:41.218061 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:41.218773 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:41.219886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:41.220343 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:41.220764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:41.450568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:41.455515 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:41.464731 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-51f969a8-71e1-424a-be39-0b667df21379 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.297227 Aug 09 11:26:41.465618 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 62/132] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:41 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:41.465781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5ab21ed8-9c1f-4b91-a1c7-3498eeaa8b49 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.283034 Aug 09 11:26:41.466402 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 71/133] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:41 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:41.477887 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:41.479504 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:41.490271 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:41.491750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:41.492864 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:41.493923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:41.494922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:41.495764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:41.704215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:41.714795 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7c6b17f3-9c06-4c7b-9813-12bfa3ec21ff tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.246815 Aug 09 11:26:41.716387 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 63/134] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:41 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:42.488920 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:42.490604 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:42.497876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:42.498847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:42.499075 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:42.500281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:42.500736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:42.501531 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:42.502097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:42.502700 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:42.529769 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:42.530623 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:42.535348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:42.540455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:42.541794 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:42.542753 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:42.799851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:42.812858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:42.824994 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a51a5605-2bdb-429f-afb2-8309ee47fadc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.334102 Aug 09 11:26:42.825606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 64/135] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:42 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:42.838728 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5c4a021e-ff73-42a8-82ec-d3f44912b1a7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.354384 Aug 09 11:26:42.840261 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 72/136] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:42 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:42.842417 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:42.843532 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:42.852645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:42.853256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:42.853765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:42.854613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:42.855125 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:42.855676 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:43.130014 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:43.138152 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9970b6fb-3f8e-48c5-9a29-590d1542f3a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.301825 Aug 09 11:26:43.138749 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 65/137] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:42 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:43.850754 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:43.851955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:43.862197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:43.863070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:43.864139 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:43.865479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:43.866188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:43.866916 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:43.884932 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:43.885707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:43.901444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:43.901961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:43.902404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:43.903180 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:43.903641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:43.904066 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:44.447405 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:44.454315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:44.457233 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f4c7b03f-0b32-476f-8674-b1b398246b20 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.614797 Aug 09 11:26:44.460476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 73/138] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:43 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:44.476044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9eb96943-5355-469a-9958-c4baa0b4211c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.594659 Aug 09 11:26:44.478479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:44.479131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:44.485687 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:44.486212 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:44.486934 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:44.487790 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 66/139] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:43 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:44.488153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:44.488805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:44.489423 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:44.695087 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:44.704948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a1a0deea-d7d3-44aa-8fff-04bfe2b71662 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.230690 Aug 09 11:26:44.708627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 74/140] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:44 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:45.481453 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:45.482676 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:45.498128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:45.500480 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:45.511887 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:45.519193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:45.519531 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:45.520256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:45.527903 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:45.528836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:45.529477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:45.531826 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:45.532617 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:45.534719 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:45.541875 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:45.545919 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:46.519404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:46.528068 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:46.538606 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-deebad13-a4c7-4ad7-b6fe-0685b584b295 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 1.044518 Aug 09 11:26:46.552996 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5b4344af-f4af-44df-875d-6438834c1ac3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 1.075283 Aug 09 11:26:46.554737 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 67/141] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:45 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:46.555193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 75/142] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:45 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:46.560222 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:46.560822 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:46.567535 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:46.568276 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:46.568909 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:46.569821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:46.570277 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:46.570699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:46.724809 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:46.739373 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-209166b6-f0d7-4fe1-8c79-e929a52b0a6b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.182726 Aug 09 11:26:46.740649 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 76/143] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:46 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:47.569605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:47.569605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:47.571930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:47.572494 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:47.572959 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:47.573650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:47.573764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:47.574150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:47.574353 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:47.574558 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:47.582908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:47.583587 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:47.584121 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:47.584926 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:47.585518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:47.586007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:47.841525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:47.850213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:47.851814 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d50022ac-d746-4fae-b78c-c1822bb36426 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.282015 Aug 09 11:26:47.867233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8c944b7a-e079-4655-b57a-7aa795fb7b84 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.306175 Aug 09 11:26:47.868814 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 77/144] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:47 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:47.869451 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 68/145] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:47 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:47.877949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:47.884342 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:47.894284 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:47.894861 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:47.895654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:47.896449 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:47.897128 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:47.897906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:48.125444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:48.143009 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-21f769eb-0a04-4973-929e-98840881b120 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.271544 Aug 09 11:26:48.147223 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 69/146] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:47 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:48.213666 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-906781c5-81bf-46a5-9f33-61af815a9504 req-83b44254-82b0-4d75-90a9-8f5566917838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aee6415-5779-4bbf-8f4d-f715e7584dab", "name": "network-vif-plugged", "status": "completed", "tag": "6ff70cac-30d2-42c4-b021-e07e78195636"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:48.227210 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-906781c5-81bf-46a5-9f33-61af815a9504 req-83b44254-82b0-4d75-90a9-8f5566917838 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:48.227689 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-906781c5-81bf-46a5-9f33-61af815a9504 req-83b44254-82b0-4d75-90a9-8f5566917838 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:48.228144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-906781c5-81bf-46a5-9f33-61af815a9504 req-83b44254-82b0-4d75-90a9-8f5566917838 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:48.240249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-906781c5-81bf-46a5-9f33-61af815a9504 req-83b44254-82b0-4d75-90a9-8f5566917838 service nova] Creating event network-vif-plugged:6ff70cac-30d2-42c4-b021-e07e78195636 for instance 7aee6415-5779-4bbf-8f4d-f715e7584dab on hv-cinder-84989 Aug 09 11:26:48.246075 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-906781c5-81bf-46a5-9f33-61af815a9504 req-83b44254-82b0-4d75-90a9-8f5566917838 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375578 Aug 09 11:26:48.250368 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 78/147] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:48.875670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:48.877064 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:48.886896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:48.890408 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:48.890967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:48.891526 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:48.892007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:48.893478 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:48.895584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:48.896401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:48.901804 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:48.902243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:48.902675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:48.903415 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:48.903873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:48.904292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:49.152110 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:49.171045 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d820bd47-95f8-42de-babf-8f95c5ac59a4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.298727 Aug 09 11:26:49.175800 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 70/148] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:48 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:49.190269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:49.192508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:49.208760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:49.217578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a31695c7-95c4-496e-a264-4ecae81db3c3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.331338 Aug 09 11:26:49.217717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:49.222991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 79/149] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:48 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:49.252909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:49.254189 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:49.258956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:49.262009 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:49.262746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:49.537261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:49.546847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e7ed9ea6-511c-48dc-b032-33f5af5ec141 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.368649 Aug 09 11:26:49.561548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 71/150] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:49 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:50.197427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:50.198006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:50.204577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:50.205069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:50.205594 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:50.206264 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:50.206714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:50.207168 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:50.252044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:50.254456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:50.261820 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:50.262583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:50.263065 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:50.263799 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:50.264481 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:50.264884 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:50.408786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:50.417653 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6b2a2b56-66a2-4cfa-90ec-6a365e3da221 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.224409 Aug 09 11:26:50.418891 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 80/151] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:50 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:50.423883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-c766bcb3-b39c-4e8c-8292-203715798a1b req-fdd50bb3-e534-4ff7-b774-4c752269921b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f727a3f9-56c8-4305-bcd5-68f8d6d31f79", "name": "network-vif-plugged", "status": "completed", "tag": "2f3704c5-212e-4b8b-b7e6-10d9252525b6"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:50.433897 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-c766bcb3-b39c-4e8c-8292-203715798a1b req-fdd50bb3-e534-4ff7-b774-4c752269921b service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:50.434654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-c766bcb3-b39c-4e8c-8292-203715798a1b req-fdd50bb3-e534-4ff7-b774-4c752269921b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:50.435247 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-c766bcb3-b39c-4e8c-8292-203715798a1b req-fdd50bb3-e534-4ff7-b774-4c752269921b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:50.452833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-c766bcb3-b39c-4e8c-8292-203715798a1b req-fdd50bb3-e534-4ff7-b774-4c752269921b service nova] Creating event network-vif-plugged:2f3704c5-212e-4b8b-b7e6-10d9252525b6 for instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 on hv-cinder-84989 Aug 09 11:26:50.460308 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-c766bcb3-b39c-4e8c-8292-203715798a1b req-fdd50bb3-e534-4ff7-b774-4c752269921b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040127 Aug 09 11:26:50.461099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 81/152] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:50.469001 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:50.477711 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-078a799e-acda-4f20-9036-f6168fe5b5d1 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.231861 Aug 09 11:26:50.478613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 72/153] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:50 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:50.568054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:50.568849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:50.575323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:50.575806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:50.576225 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:50.576915 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:50.577361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:50.577776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:50.724119 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:50.733254 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-24b762c1-a574-4fd0-905b-d06e21bd65e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.169430 Aug 09 11:26:50.733971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 82/154] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:50 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:51.449877 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:51.450920 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:51.461855 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:51.462634 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:51.463519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:51.475537 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:51.476247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:51.478411 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:51.504691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:51.507468 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:51.518170 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:51.518789 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:51.519430 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:51.520299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:51.520973 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:51.521706 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:51.789026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:51.792521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:51.797602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5989f7f0-48ad-40f2-a91b-08145002bd10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.357528 Aug 09 11:26:51.797602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 73/155] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:51 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:51.801206 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f04615d6-70c9-49c2-88db-c82c05ea52f3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.304860 Aug 09 11:26:51.801856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 83/156] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:51 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:51.807356 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:51.810227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:51.821210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:51.821711 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:51.822148 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:51.822936 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:51.823399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:51.823826 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:51.970367 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:51.979080 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bf4488e4-9c95-425c-b209-8bd88fb546cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.180086 Aug 09 11:26:51.979654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 74/157] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:51 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:52.823171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:52.824667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:52.833170 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:52.834579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:52.838913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:52.839691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:52.840765 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:52.841709 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:52.842066 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:52.842243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:52.842661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:52.843224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:52.843403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:52.843947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:52.844116 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:52.844456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:53.091187 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:53.093282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:53.098989 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3a3f425f-cf2e-4f93-8c98-feed7cab13d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.269711 Aug 09 11:26:53.099772 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 75/158] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:52 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:53.105834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:53.106790 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:53.113887 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:53.114348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:53.115266 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:53.116234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:53.116851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:53.117793 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:53.117919 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ec2a8273-4d7d-4f01-9b95-8d13788c10ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.301254 Aug 09 11:26:53.118997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 84/159] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:52 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:53.280972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:53.288373 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1e401e88-743c-4e96-8cf5-e8a438e17de5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.187357 Aug 09 11:26:53.288881 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 76/160] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:53 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:54.135690 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:54.143134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:54.145316 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:54.145919 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:54.161513 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:54.163096 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:54.163864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:54.164857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:54.164984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:54.165916 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:54.166559 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:54.172600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:54.173390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:54.174682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:54.175568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:54.176326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:54.411618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:54.417486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:54.425918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b90e5921-f37e-4e82-bd00-1fdb884cfda7 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.293732 Aug 09 11:26:54.427160 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 85/161] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:54 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:54.443103 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:54.443917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:54.451924 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:54.452868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:54.453344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:54.454046 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:54.454699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:54.455144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:54.488591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:54.498405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d270860f-fe2f-4b78-926b-fa45e7b5b17c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.359025 Aug 09 11:26:54.499703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 77/162] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:54 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:54.637150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:54.645779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5caea3eb-f035-43c2-9b3e-1d3df6cfa51c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.216953 Aug 09 11:26:54.646763 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 86/163] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:54 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:55.449027 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:55.450439 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:55.461771 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:55.462306 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:55.462740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:55.467665 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:55.468233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:55.470126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:55.531785 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:55.532606 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:55.560757 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:55.561355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:55.561901 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:55.562950 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:55.563796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:55.574076 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:55.808031 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:55.811951 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:55.819074 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-00db2bd0-765c-4c38-91c3-4b7d6baa1e53 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.374863 Aug 09 11:26:55.819918 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 78/164] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:55 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:55.841318 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:55.841950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:55.862905 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:55.863482 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:55.866114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:55.867296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:55.868021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:55.870042 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:55.978903 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:55.991048 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-62fe8b97-f2bc-4aa2-bafd-74a9abf3af91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.472703 Aug 09 11:26:55.996234 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 87/165] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:55 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:56.145640 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:56.154466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-128793a7-1bfd-427c-a603-9e192d20cc6e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.317001 Aug 09 11:26:56.164912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 79/166] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:55 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:56.841365 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:56.842025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:56.844317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=68 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:56.850064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:56.852293 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:56.855567 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:56.856461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:56.857100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:56.857696 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:57.016300 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:57.016944 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:57.024216 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:57.024959 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:57.025541 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:57.026739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:57.027770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:57.028190 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:57.157280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:57.170542 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-71184aaf-84db-42e6-a420-67e69fb3a155 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1313 microversion: 2.1 time: 0.333949 Aug 09 11:26:57.184172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 88/167] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:56 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:57.196745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:57.198449 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:57.207582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:57.208612 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:57.209220 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:57.210296 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:57.210745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:57.211238 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:57.294429 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:57.305088 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3e7def7f-1142-4054-a1f6-a23a7de43f7b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.292598 Aug 09 11:26:57.318322 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 80/168] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:57 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:57.423205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:57.432082 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-757bb0df-fb54-475e-a886-db176d7c166f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.245870 Aug 09 11:26:57.447167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 89/169] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:57 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:58.217780 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:58.218538 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:58.250213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=66 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:58.254202 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:58.255537 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:58.256330 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:58.257337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:58.257970 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:58.258555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:58.328188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:58.329104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:58.348044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:58.356464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:58.358162 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:58.364889 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:58.371400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:58.372751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:58.538245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:58.548412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c979f1d6-58ff-4332-b9f9-22ec57216cf5 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1500 microversion: 2.1 time: 0.354499 Aug 09 11:26:58.549908 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 81/170] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:58 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1500 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:26:58.585139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:58.595085 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:58.634007 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:58.634673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:58.639365 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:58.640304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:58.640704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:58.641153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:58.881286 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:58.897114 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ca8d5ef2-bce9-4f9f-8024-03b1a51d8735 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.574855 Aug 09 11:26:58.897938 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 90/171] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:58 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:58.928671 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-210fc622-0cdb-416a-82a0-9f66ddfa2ac0 req-4bf6ebdc-621b-4543-ae29-b2198db507fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47718566-e01b-41e5-bdc1-ba691dc04c2c", "name": "network-vif-plugged", "status": "completed", "tag": "a4cec858-ffac-4590-8c8f-19f2d2926a37"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:26:58.933043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:26:58.942293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-08d0ec6e-7f48-4fca-922e-b21f737431d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.390963 Aug 09 11:26:58.944321 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 82/172] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:58 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:26:58.975707 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-210fc622-0cdb-416a-82a0-9f66ddfa2ac0 req-4bf6ebdc-621b-4543-ae29-b2198db507fd service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:58.976826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-210fc622-0cdb-416a-82a0-9f66ddfa2ac0 req-4bf6ebdc-621b-4543-ae29-b2198db507fd service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:58.977488 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-210fc622-0cdb-416a-82a0-9f66ddfa2ac0 req-4bf6ebdc-621b-4543-ae29-b2198db507fd service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:59.013782 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-210fc622-0cdb-416a-82a0-9f66ddfa2ac0 req-4bf6ebdc-621b-4543-ae29-b2198db507fd service nova] Creating event network-vif-plugged:a4cec858-ffac-4590-8c8f-19f2d2926a37 for instance 47718566-e01b-41e5-bdc1-ba691dc04c2c on hv-cinder-84989 Aug 09 11:26:59.022678 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-210fc622-0cdb-416a-82a0-9f66ddfa2ac0 req-4bf6ebdc-621b-4543-ae29-b2198db507fd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122672 Aug 09 11:26:59.023465 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 91/173] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:26:59.921842 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:59.924989 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:59.938426 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:59.939034 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:59.939759 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:59.940715 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:59.941421 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:59.942056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:59.965395 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:26:59.967743 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:26:59.982709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:59.983651 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:59.984093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:26:59.984841 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:26:59.985302 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:26:59.985731 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:00.277411 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:00.291054 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9d27ec7b-70c6-47ed-a446-86d1fa061cb2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.376992 Aug 09 11:27:00.297807 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:00.302157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 83/174] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:59 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:00.306635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f77bc7b9-a2a1-47ff-b64e-2538009faa3d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.345615 Aug 09 11:27:00.308760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 92/175] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:26:59 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:00.492267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bb6b16f8-74b8-4113-b9a8-c3e7ccfc8fd0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7551e858-f1d9-4c82-9e45-b8e9b94c54bd"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:00.495103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bb6b16f8-74b8-4113-b9a8-c3e7ccfc8fd0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:00.506339 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb6b16f8-74b8-4113-b9a8-c3e7ccfc8fd0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:00.506902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb6b16f8-74b8-4113-b9a8-c3e7ccfc8fd0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:00.507343 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb6b16f8-74b8-4113-b9a8-c3e7ccfc8fd0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:00.508263 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb6b16f8-74b8-4113-b9a8-c3e7ccfc8fd0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:00.508721 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb6b16f8-74b8-4113-b9a8-c3e7ccfc8fd0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:00.509308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb6b16f8-74b8-4113-b9a8-c3e7ccfc8fd0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:01.077675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-2dbf3dba-e95e-417a-bdd2-cec9ad33100b req-5498d77a-ca39-4740-9f92-b858467ebe42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a396c8a-da73-40f4-b239-d344970cdbcd", "name": "network-vif-plugged", "status": "completed", "tag": "c02f7ff1-bbb1-4b12-b948-d5b92e1df60a"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:01.094838 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2dbf3dba-e95e-417a-bdd2-cec9ad33100b req-5498d77a-ca39-4740-9f92-b858467ebe42 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:01.095566 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2dbf3dba-e95e-417a-bdd2-cec9ad33100b req-5498d77a-ca39-4740-9f92-b858467ebe42 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:01.096504 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2dbf3dba-e95e-417a-bdd2-cec9ad33100b req-5498d77a-ca39-4740-9f92-b858467ebe42 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:01.111206 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-2dbf3dba-e95e-417a-bdd2-cec9ad33100b req-5498d77a-ca39-4740-9f92-b858467ebe42 service nova] Creating event network-vif-plugged:c02f7ff1-bbb1-4b12-b948-d5b92e1df60a for instance 5a396c8a-da73-40f4-b239-d344970cdbcd on hv-cinder-84989 Aug 09 11:27:01.130360 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-2dbf3dba-e95e-417a-bdd2-cec9ad33100b req-5498d77a-ca39-4740-9f92-b858467ebe42 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054359 Aug 09 11:27:01.135872 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 93/176] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:01.330148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:01.331473 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:01.343133 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:01.344742 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:01.345710 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:01.347315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:01.348697 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:01.349804 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:01.888630 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bb6b16f8-74b8-4113-b9a8-c3e7ccfc8fd0 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "POST /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.400848 Aug 09 11:27:01.891129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 84/177] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:27:00 2022] POST /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab/os-volume_attachments => generated 194 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:01.901166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:01.914372 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-44da3f0c-fc7e-4217-86f1-4931c4c01a38 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1365 microversion: 2.1 time: 0.591857 Aug 09 11:27:01.916902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 94/178] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:01 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1365 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:01.923889 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:01.924733 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:01.941329 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:01.942223 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:01.944226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:01.945370 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:01.946056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:01.946664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:02.177156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:02.188334 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bf213dfb-0263-4ef8-b9ce-6ac77cb0b433 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.294014 Aug 09 11:27:02.190224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 85/179] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:01 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:02.940798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:02.942045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:02.949105 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:02.950079 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:02.950874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:02.951761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:02.952212 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:02.952699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:03.210260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:03.211747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:03.227011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:03.227519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:03.227985 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:03.233155 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:03.233622 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:03.234247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:03.296163 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:03.304809 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3f09deb3-6948-4f2c-af71-6640f86b0fe7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1554 microversion: 2.1 time: 0.372484 Aug 09 11:27:03.305817 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 95/180] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:02 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1554 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:03.330172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a432117c-a8a5-4277-a116-e6948d770710 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:03.331250 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a432117c-a8a5-4277-a116-e6948d770710 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:03.342490 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a432117c-a8a5-4277-a116-e6948d770710 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:03.343305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a432117c-a8a5-4277-a116-e6948d770710 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:03.343944 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a432117c-a8a5-4277-a116-e6948d770710 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:03.344862 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a432117c-a8a5-4277-a116-e6948d770710 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:03.345528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a432117c-a8a5-4277-a116-e6948d770710 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:03.346407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a432117c-a8a5-4277-a116-e6948d770710 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:03.487156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:03.496149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4de2911b-9d32-4bbd-bb1f-faa8c84fc780 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1322 microversion: 2.1 time: 0.290347 Aug 09 11:27:03.504063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 86/181] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:03 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:03.560537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a432117c-a8a5-4277-a116-e6948d770710 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234287 Aug 09 11:27:03.561135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 96/182] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 11:27:03 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:04.524154 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:04.526073 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:04.533268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:04.534024 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:04.534615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:04.535689 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:04.536295 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:04.536967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:04.842288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:04.852680 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-77d54f86-feb3-42c7-b1dc-6ce7351a3ab1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1517 microversion: 2.1 time: 0.331715 Aug 09 11:27:04.866843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 87/183] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:04 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1517 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:04.883121 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:04.887575 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:04.908078 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:04.909949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:04.913201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:04.914853 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:04.916996 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:04.917544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:04.973526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lazy-loading 'flavor' on Instance uuid 5a396c8a-da73-40f4-b239-d344970cdbcd {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:27:05.148746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-443897d3-9b64-4265-b075-ec808a68ab50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd/action" status: 200 len: 32 microversion: 2.1 time: 0.273896 Aug 09 11:27:05.150592 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 97/184] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:27:04 2022] POST /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:27:05.164982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:05.169266 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:05.194961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:05.196949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:05.199418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:05.200326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:05.205181 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:05.206522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:05.693083 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-78163405-b844-473e-9ac2-1c569d75993c req-cfcc45b9-dd6d-4288-833d-f39d764fa4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47718566-e01b-41e5-bdc1-ba691dc04c2c", "tag": "a4cec858-ffac-4590-8c8f-19f2d2926a37"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:05.708799 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:05.721715 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5d4e0741-a755-45a3-83b5-070859e83365 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.565436 Aug 09 11:27:05.730849 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 88/185] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:05 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:05.739926 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-78163405-b844-473e-9ac2-1c569d75993c req-cfcc45b9-dd6d-4288-833d-f39d764fa4d1 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:05.742496 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-78163405-b844-473e-9ac2-1c569d75993c req-cfcc45b9-dd6d-4288-833d-f39d764fa4d1 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:05.754195 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-78163405-b844-473e-9ac2-1c569d75993c req-cfcc45b9-dd6d-4288-833d-f39d764fa4d1 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:05.822380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-78163405-b844-473e-9ac2-1c569d75993c req-cfcc45b9-dd6d-4288-833d-f39d764fa4d1 service nova] Creating event network-changed:a4cec858-ffac-4590-8c8f-19f2d2926a37 for instance 47718566-e01b-41e5-bdc1-ba691dc04c2c on hv-cinder-84989 Aug 09 11:27:05.849298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-78163405-b844-473e-9ac2-1c569d75993c req-cfcc45b9-dd6d-4288-833d-f39d764fa4d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171230 Aug 09 11:27:05.850079 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 98/186] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:06.745295 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:06.746677 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:06.759111 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:06.759608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:06.760044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:06.764044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:06.764608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:06.765092 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:07.031044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:07.041212 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-97bf956a-943b-41e7-8abd-eb657e61edce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.299888 Aug 09 11:27:07.042592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 89/187] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:06 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:08.081380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:08.082894 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:08.101204 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:08.102442 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:08.105645 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:08.110563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:08.115068 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:08.119382 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:08.383090 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:08.395696 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-da822803-4de8-4123-a9fa-ab9f13b41228 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.332042 Aug 09 11:27:08.403681 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 99/188] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:08 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:09.423167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:09.423828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:09.433902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:09.434140 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:09.435971 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:09.438068 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:09.439532 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:09.441508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:09.650418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:09.660237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1744dfd7-792b-45e1-ae5e-8e71b6a5861e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.241828 Aug 09 11:27:09.661258 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 90/189] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:09 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:10.694846 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:10.695663 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:10.702035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:10.702513 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:10.702986 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:10.704035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:10.704500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:10.704929 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:10.848805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:10.856665 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b0efc501-b6b2-4154-8e98-513f8ea212bf tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.165785 Aug 09 11:27:10.857249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 100/190] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:10 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:11.878191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:11.879484 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:11.885961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:11.886453 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:11.886926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:11.887844 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:11.888260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:11.889061 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:11.970716 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-210867700", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "networks": [{"uuid": "1bb8f388-3f80-4d6b-aae2-3975dc034a06"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:12.049349 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] validate_networks() for [('1bb8f388-3f80-4d6b-aae2-3975dc034a06', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:27:12.502675 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:12.515194 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c051e00b-17ac-4a52-b91a-bf8441b835f8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.637068 Aug 09 11:27:12.516897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 91/191] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:11 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:12.523544 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:12.524362 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:12.544859 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:12.546952 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:12.547650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:12.548658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:12.549854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:12.551113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:12.585692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:27:12.709745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:12.775644 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-54c2fb10-5bf1-4cb4-816e-e8b66043a268 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 204 len: 0 microversion: 2.1 time: 0.255909 Aug 09 11:27:12.776516 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 92/192] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:27:12 2022] DELETE /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:27:12.788561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:12.789798 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:12.805291 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:12.806160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:12.806842 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:12.808085 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:12.808868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:12.809502 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:13.081769 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:13.082739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:27:13.083976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:27:13.084767 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:27:13.085925 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:27:13.086877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:27:13.091139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fbe26b4a-dd94-4bd7-b6f9-d05225a88438 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1552 microversion: 2.1 time: 0.307633 Aug 09 11:27:13.091740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 93/193] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:12 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1552 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:13.114198 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:13.115687 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:13.116539 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:13.118216 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:13.119642 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:13.120465 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:13.150122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Getting quotas for project bfc240016ba8447da04bbf7804e3d801. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:27:13.155682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Getting quotas for user 20fa4a9037534826bb11e503c20b4dcb and project bfc240016ba8447da04bbf7804e3d801. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:27:13.170434 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:27:13.173824 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:27:13.238628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-887412ae-4a34-4c80-ba7f-a50bfda6a497 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274952 Aug 09 11:27:13.239617 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 101/194] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:27:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:27:13.250569 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c210b7c8-593e-4323-b7cf-58eb7fbf78ef tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:13.251529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c210b7c8-593e-4323-b7cf-58eb7fbf78ef tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:13.316949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c210b7c8-593e-4323-b7cf-58eb7fbf78ef tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:13.329692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c210b7c8-593e-4323-b7cf-58eb7fbf78ef tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1213 microversion: 2.1 time: 0.082566 Aug 09 11:27:13.336058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 94/195] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:13 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:13.539106 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:13.540359 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:13.550918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:13.551991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:13.553738 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:13.555722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:13.556268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:13.556616 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:13.782420 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:13.790765 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5e7484ed-b76e-4fd8-bead-7d06b0c008d2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.256019 Aug 09 11:27:13.791695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 102/196] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:13 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:14.128900 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:14.129637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:14.136485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:14.136977 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:14.137425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:14.138139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:14.138774 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:14.139232 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:14.287184 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:14.295876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5c73f572-c7a7-4b58-8731-fbd80c50f9be tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1552 microversion: 2.1 time: 0.170861 Aug 09 11:27:14.296617 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 95/197] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:14 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:14.363947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:14.364739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:14.371662 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:14.372137 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:14.372695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:14.373519 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:14.373930 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:14.374408 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:14.395063 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:14.453620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:14.461914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91a00998-abdf-45f0-b7b6-9d934b56d475 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1217 microversion: 2.1 time: 0.101898 Aug 09 11:27:14.462528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 103/198] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:14 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:14.813671 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:14.814256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:14.821085 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:14.821643 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:14.822077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:14.822782 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:14.823256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:14.823677 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:14.978163 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:14.993889 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ad85b4aa-038b-4f5e-9a14-e38381e1126e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.184206 Aug 09 11:27:14.999708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 96/199] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:14 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:15.321281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:15.322529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:15.342263 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:15.343951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:15.345601 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:15.346618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:15.347478 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:15.348308 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:15.488709 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:15.489414 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:15.499847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:15.501745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:15.502323 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:15.503425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:15.504234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:15.504867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:15.530608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:15.549295 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6ec8f6f7-73c8-488b-8941-75fcb415ce6f tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1552 microversion: 2.1 time: 0.235254 Aug 09 11:27:15.551106 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 104/200] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:15 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1552 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:15.601268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:15.611283 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-29d16d56-8289-4f44-be66-81fee9555fe1 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1265 microversion: 2.1 time: 0.127587 Aug 09 11:27:15.611770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 97/201] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:15 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:16.027769 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:16.029649 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:16.037031 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.037818 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.038628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.039803 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.040511 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.041357 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.258567 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:16.267092 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-27961826-de30-4c5d-b4d0-313c627627a6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.245731 Aug 09 11:27:16.267689 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 105/202] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:16 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:16.585005 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:16.586912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:16.633313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.633558 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:16.634361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:16.639625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.641495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.644890 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.645376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.645813 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.657806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.659046 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.660506 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.661260 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:16.663286 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:16.665349 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:16.762202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:16.771287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-265222c2-bd63-439f-889b-3e8471dceee9 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1271 microversion: 2.1 time: 0.142437 Aug 09 11:27:16.775563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 106/203] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:16 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:16.912764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:16.926663 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-903d551d-6d84-41af-8ac7-7836342cf68d tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1552 microversion: 2.1 time: 0.345315 Aug 09 11:27:16.928999 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 98/204] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:16 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1552 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:17.257457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-972ef2b9-d5e5-4f86-b756-32a39315f70d req-49a08397-ec9b-4d79-aa07-688e0868f9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aee6415-5779-4bbf-8f4d-f715e7584dab", "name": "network-vif-deleted", "tag": "6ff70cac-30d2-42c4-b021-e07e78195636"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:17.274341 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-972ef2b9-d5e5-4f86-b756-32a39315f70d req-49a08397-ec9b-4d79-aa07-688e0868f9c0 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:17.275409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-972ef2b9-d5e5-4f86-b756-32a39315f70d req-49a08397-ec9b-4d79-aa07-688e0868f9c0 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:17.276029 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-972ef2b9-d5e5-4f86-b756-32a39315f70d req-49a08397-ec9b-4d79-aa07-688e0868f9c0 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:17.288637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:17.289651 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:17.302002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:17.302967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:17.304064 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:17.307714 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:17.308435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:17.309078 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:17.316215 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-972ef2b9-d5e5-4f86-b756-32a39315f70d req-49a08397-ec9b-4d79-aa07-688e0868f9c0 service nova] Creating event network-vif-deleted:6ff70cac-30d2-42c4-b021-e07e78195636 for instance 7aee6415-5779-4bbf-8f4d-f715e7584dab on hv-cinder-84989 Aug 09 11:27:17.322772 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-972ef2b9-d5e5-4f86-b756-32a39315f70d req-49a08397-ec9b-4d79-aa07-688e0868f9c0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085608 Aug 09 11:27:17.324060 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 107/205] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:17.536626 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:17.544579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4ac4c74b-3cbf-4a61-b58d-c58319e8a396 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.260298 Aug 09 11:27:17.545250 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 99/206] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:17 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:17.802959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:17.803916 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:17.812879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:17.813448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:17.813902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:17.814901 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:17.815545 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:17.816157 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:17.952464 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:17.953084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:17.965882 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:17.976446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:17.978848 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:17.983599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:17.987688 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:17.989383 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:18.011036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:18.019348 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ed04139a-0376-43b1-831c-a73204b9a1c8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.221452 Aug 09 11:27:18.025904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 108/207] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:17 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:18.139165 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b3cd9e2c3e48c299037759cab9ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec50a06edc0445e798202c786b37aa19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:18.191215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-13d05437-ad43-44bc-b9d8-b502b8c36c29 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 200 len: 1344 microversion: 2.1 time: 0.246316 Aug 09 11:27:18.194128 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 100/208] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:17 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 1344 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:18.571666 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:18.572603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:18.581028 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:18.581611 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:18.582333 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:18.583347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:18.583875 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:18.584379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:18.806507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:18.838057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bf834560-c60e-4d42-add6-767db1a850d1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.273235 Aug 09 11:27:18.838842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 109/209] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:18 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:19.047423 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:19.052407 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:19.058906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:19.059389 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:19.066212 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:19.067015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:19.067486 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:19.067920 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:19.221631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:19.235974 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:19.260631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:19.264552 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:19.265396 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:19.267588 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:19.268377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:19.272375 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:19.309206 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] HTTP exception thrown: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Request method failure captured: Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab HTTP/1.1 Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRH_yH5cvyZc83IMusmlRMAS5StTapY2AlmcjKPVy9nocBiE5Qr9lrprHnGl2UEYxEDyJ3wQV5T_Wj-eKpKSxzNpjE2TmepM1v4iWZ-VtHW0mlcNvZU9kCeXJNVj6NFt7eSFRg0EVQ_oFJclfF2hdSmaXYNsbOt0JswLje1xHLq45I Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: ec50a06edc0445e798202c786b37aa19 Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:27:19.313709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec50a06edc0445e798202c786b37aa19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: ec50a06edc0445e798202c786b37aa19 Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-DeleteServersTestJSON-639967261-project Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 00b3cd9e2c3e48c299037759cab9ccce Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-DeleteServersTestJSON-639967261-project Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.315836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '7aee6415-5779-4bbf-8f4d-f715e7584dab'} Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:27:19.317921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.321507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.325514 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:19.326711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Returning 404 to user: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:27:19.326711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3ec6fa27-d15e-4357-8abc-90a5acd7c8f2 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 404 len: 111 microversion: 2.1 time: 0.100617 Aug 09 11:27:19.326711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 110/210] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:19 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:27:19.328149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2ea78585-759d-4a62-bf4e-11eca1cc42bf tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.285174 Aug 09 11:27:19.329426 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 101/211] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:19 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:19.368463 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e037c593-d837-4aca-8dd8-a8180f1b0d77 req-2710b446-8be8-41c8-b26b-f5ec85376119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2cd59e-1c76-4662-ac8a-7aa8e6b98959", "tag": "61e76c94-8519-40ac-8891-9ab85eb72af5"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:19.380203 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e037c593-d837-4aca-8dd8-a8180f1b0d77 req-2710b446-8be8-41c8-b26b-f5ec85376119 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:19.380677 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e037c593-d837-4aca-8dd8-a8180f1b0d77 req-2710b446-8be8-41c8-b26b-f5ec85376119 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:19.381099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e037c593-d837-4aca-8dd8-a8180f1b0d77 req-2710b446-8be8-41c8-b26b-f5ec85376119 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:19.406928 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e037c593-d837-4aca-8dd8-a8180f1b0d77 req-2710b446-8be8-41c8-b26b-f5ec85376119 service nova] Creating event network-changed:61e76c94-8519-40ac-8891-9ab85eb72af5 for instance ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 on hv-cinder-84989 Aug 09 11:27:19.417104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e037c593-d837-4aca-8dd8-a8180f1b0d77 req-2710b446-8be8-41c8-b26b-f5ec85376119 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053132 Aug 09 11:27:19.417920 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 111/212] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:19.471648 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:19.474500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:19.488459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:19.489052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:19.489557 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:19.490312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:19.491005 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:19.491434 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:19.506740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] HTTP exception thrown: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Request method failure captured: Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab/os-volume_attachments HTTP/1.1 Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRH_yH5cvyZc83IMusmlRMAS5StTapY2AlmcjKPVy9nocBiE5Qr9lrprHnGl2UEYxEDyJ3wQV5T_Wj-eKpKSxzNpjE2TmepM1v4iWZ-VtHW0mlcNvZU9kCeXJNVj6NFt7eSFRg0EVQ_oFJclfF2hdSmaXYNsbOt0JswLje1xHLq45I Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: ec50a06edc0445e798202c786b37aa19 Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:27:19.511260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec50a06edc0445e798202c786b37aa19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: ec50a06edc0445e798202c786b37aa19 Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-DeleteServersTestJSON-639967261-project Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 00b3cd9e2c3e48c299037759cab9ccce Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-DeleteServersTestJSON-639967261-project Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.512636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'server_id': '7aee6415-5779-4bbf-8f4d-f715e7584dab'} Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:27:19.513548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:19.517016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:19.518599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Returning 404 to user: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:27:19.518599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-70af1c0f-fd08-4fab-9406-2176a4dc9c75 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047271 Aug 09 11:27:19.518599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 102/213] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:27:19 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:27:19.861034 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:19.862141 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:19.872842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:19.876477 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:19.877902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:19.878902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:19.879392 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:19.880080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:20.056699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:20.064632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9ee16a58-ba75-4f03-b984-956dd02937eb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.208550 Aug 09 11:27:20.065553 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 112/214] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:19 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:20.370977 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:20.370977 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:20.382236 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:20.383077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:20.383748 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:20.384880 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:20.385891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:20.386952 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:20.592079 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:20.607941 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-be584879-ad28-4df9-ba73-6ef33f8cedd3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.246603 Aug 09 11:27:20.617818 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 103/215] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:20 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:20.776102 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:20.776625 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:20.784385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:20.784385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:20.784385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:20.784778 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:20.785201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:20.785623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:20.799376 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] HTTP exception thrown: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Request method failure captured: Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab HTTP/1.1 Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRH_yH5cvyZc83IMusmlRMAS5StTapY2AlmcjKPVy9nocBiE5Qr9lrprHnGl2UEYxEDyJ3wQV5T_Wj-eKpKSxzNpjE2TmepM1v4iWZ-VtHW0mlcNvZU9kCeXJNVj6NFt7eSFRg0EVQ_oFJclfF2hdSmaXYNsbOt0JswLje1xHLq45I Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: ec50a06edc0445e798202c786b37aa19 Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:27:20.801171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec50a06edc0445e798202c786b37aa19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: ec50a06edc0445e798202c786b37aa19 Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-DeleteServersTestJSON-639967261-project Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 00b3cd9e2c3e48c299037759cab9ccce Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-DeleteServersTestJSON-639967261-project Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.802563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '7aee6415-5779-4bbf-8f4d-f715e7584dab'} Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:27:20.803314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.804686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.806000 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Returning 404 to user: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:27:20.806000 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3536980c-1a11-4010-810c-bcbdeaf4d3d3 tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 404 len: 111 microversion: 2.1 time: 0.030513 Aug 09 11:27:20.806000 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 113/216] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:27:20 2022] DELETE /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:27:20.811605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:20.812213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] [instance: 7aee6415-5779-4bbf-8f4d-f715e7584dab] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:20.818681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:20.819199 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:20.819627 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:20.820323 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:20.820769 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:20.821159 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:20.835380 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] HTTP exception thrown: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Request method failure captured: Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab HTTP/1.1 Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRH_yH5cvyZc83IMusmlRMAS5StTapY2AlmcjKPVy9nocBiE5Qr9lrprHnGl2UEYxEDyJ3wQV5T_Wj-eKpKSxzNpjE2TmepM1v4iWZ-VtHW0mlcNvZU9kCeXJNVj6NFt7eSFRg0EVQ_oFJclfF2hdSmaXYNsbOt0JswLje1xHLq45I Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: ec50a06edc0445e798202c786b37aa19 Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:27:20.837568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec50a06edc0445e798202c786b37aa19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec50a06edc0445e798202c786b37aa19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: ec50a06edc0445e798202c786b37aa19 Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-DeleteServersTestJSON-639967261 Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-DeleteServersTestJSON-639967261-project Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 00b3cd9e2c3e48c299037759cab9ccce Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-DeleteServersTestJSON-639967261-project Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.838987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '7aee6415-5779-4bbf-8f4d-f715e7584dab'} Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:27:20.843207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. Aug 09 11:27:20.844597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:20.846029 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] Returning 404 to user: Instance 7aee6415-5779-4bbf-8f4d-f715e7584dab could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:27:20.846029 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-baef85de-a71d-491f-aa8c-04cf49f05f7c tempest-DeleteServersTestJSON-639967261 tempest-DeleteServersTestJSON-639967261-project] 10.222.0.59 "GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab" status: 404 len: 111 microversion: 2.1 time: 0.031303 Aug 09 11:27:20.846029 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 104/217] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:20 2022] GET /compute/v2.1/servers/7aee6415-5779-4bbf-8f4d-f715e7584dab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:27:21.086215 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:21.086768 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:21.094123 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:21.094612 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:21.095087 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:21.095799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:21.096247 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:21.096664 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:21.351774 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:21.360103 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a2a58e21-c22f-47cc-bd5a-0c00eeec5d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.277978 Aug 09 11:27:21.360661 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 114/218] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:21 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:21.639579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:21.639579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:21.646591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:21.646885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:21.647398 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:21.648526 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:21.648991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:21.649418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:21.743855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1823145449", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:21.825909 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] validate_networks() for None {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:27:21.964095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:21.972897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c4eb8784-0596-4a7a-87ec-032c89a75e0b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.339431 Aug 09 11:27:21.973488 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 105/219] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:21 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:22.262831 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:27:22.263311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:27:22.263718 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:27:22.264175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:27:22.264604 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:27:22.275981 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:22.276908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:22.276908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:22.277938 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:22.278584 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:22.279190 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:22.301140 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Getting quotas for project 7fec1f5ba8ef43ba9a04a16e17b9ad6d. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:27:22.306747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Getting quotas for user 72941424337943908351c9d6c812ce97 and project 7fec1f5ba8ef43ba9a04a16e17b9ad6d. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:27:22.326532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:27:22.330483 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:27:22.390527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:22.393666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:22.426003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:22.435002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:22.436423 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:22.438404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:22.439558 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:22.440552 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:22.455151 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fd494c5b-fd77-45aa-90c8-1653ef4a5b2a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708234 Aug 09 11:27:22.455151 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 115/220] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:27:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 11:27:22.491177 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c9d5e181-7b1e-4fd2-a5f4-08273899e40c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:22.491967 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c9d5e181-7b1e-4fd2-a5f4-08273899e40c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:22.602197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c9d5e181-7b1e-4fd2-a5f4-08273899e40c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:22.612270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c9d5e181-7b1e-4fd2-a5f4-08273899e40c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1215 microversion: 2.1 time: 0.126046 Aug 09 11:27:22.613404 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 116/221] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:22 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:22.809293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:22.819845 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7c6484e7-e44c-411f-8d71-e4005f8402a1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.441230 Aug 09 11:27:22.820452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 106/222] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:22 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:23.006973 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:23.007606 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:23.022350 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:23.022869 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:23.025525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:23.026207 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:23.026672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:23.027127 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:23.286449 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:23.297684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1105aa79-5dcd-41d3-bcd0-6efe6b41d7a7 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.305658 Aug 09 11:27:23.299769 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 117/223] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:22 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:23.655071 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:23.656036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:23.658339 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:23.667932 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:23.668688 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:23.669298 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:23.670198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:23.670835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:23.672319 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:23.779523 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:23.796757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b33b891e-5587-4948-814b-221165612926 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1267 microversion: 2.1 time: 0.152334 Aug 09 11:27:23.799139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 107/224] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:23 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:23.868289 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:23.869909 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:23.881832 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:23.883271 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:23.885167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:23.886793 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:23.887968 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:23.889375 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:24.328478 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:24.329576 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:24.360798 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:24.361952 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:24.362616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:24.363792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:24.365428 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:24.366154 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:24.726302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:24.732366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:24.747245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-11b10b5b-a531-4a3e-9f27-be7cff22cdc8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.419500 Aug 09 11:27:24.747245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 108/225] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:24 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:24.756709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e2d842d0-70d1-4139-a518-bb5c8bfe8049 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.899245 Aug 09 11:27:24.757510 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 118/226] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:23 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:24.824898 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:24.826183 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:24.834730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:24.835252 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:24.835683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:24.836373 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:24.836816 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:24.837311 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:24.943621 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:24.957176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ab13b153-3a7c-4642-b936-7fd46df66fe9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1273 microversion: 2.1 time: 0.138149 Aug 09 11:27:24.971618 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 109/227] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:24 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:25.758540 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:25.759182 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:25.765755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:25.767656 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:25.768140 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:25.770676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:25.779592 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:25.780420 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:25.793599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:25.794290 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:25.838938 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:25.839841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:25.840681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:25.841660 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:25.842374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:25.843044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:26.262751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:26.275646 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91d59b5f-6b43-4a69-9766-7a96fa9279df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.520712 Aug 09 11:27:26.278485 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 119/228] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:25 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:26.283785 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:26.284813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:26.312676 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:26.314746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:26.315277 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:26.315785 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:26.316689 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:26.317316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:26.324523 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:26.326505 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6af5ef05-8129-439b-af48-d02ddab46c01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.551617 Aug 09 11:27:26.327973 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 110/229] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:25 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:26.602843 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:26.611813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e49fe868-b8c2-41a1-9f4f-a29b2700c75b tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.331964 Aug 09 11:27:26.612667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 120/230] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:26 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:26.700508 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-6436930f-3275-4404-9cd5-0876f5b27271 req-5b6e9c7e-fb04-471d-ab90-3c712cc93773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2cd59e-1c76-4662-ac8a-7aa8e6b98959", "name": "network-vif-plugged", "status": "completed", "tag": "61e76c94-8519-40ac-8891-9ab85eb72af5"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:26.703622 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-16a6f0a3-1b3a-4531-b92b-56016241d3c3 req-7d5e8334-076d-489b-9d4d-7e4ab4abc7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04eadd8a-1b15-4226-8c0f-98d8a7687f52", "tag": "a3382375-d160-4e36-a97c-911aa245b179"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:26.731715 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6436930f-3275-4404-9cd5-0876f5b27271 req-5b6e9c7e-fb04-471d-ab90-3c712cc93773 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:26.732199 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6436930f-3275-4404-9cd5-0876f5b27271 req-5b6e9c7e-fb04-471d-ab90-3c712cc93773 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:26.732693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6436930f-3275-4404-9cd5-0876f5b27271 req-5b6e9c7e-fb04-471d-ab90-3c712cc93773 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:26.756161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-16a6f0a3-1b3a-4531-b92b-56016241d3c3 req-7d5e8334-076d-489b-9d4d-7e4ab4abc7de service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:26.756649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-16a6f0a3-1b3a-4531-b92b-56016241d3c3 req-7d5e8334-076d-489b-9d4d-7e4ab4abc7de service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:26.757078 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-16a6f0a3-1b3a-4531-b92b-56016241d3c3 req-7d5e8334-076d-489b-9d4d-7e4ab4abc7de service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:26.761161 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-6436930f-3275-4404-9cd5-0876f5b27271 req-5b6e9c7e-fb04-471d-ab90-3c712cc93773 service nova] Creating event network-vif-plugged:61e76c94-8519-40ac-8891-9ab85eb72af5 for instance ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 on hv-cinder-84989 Aug 09 11:27:26.777333 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-6436930f-3275-4404-9cd5-0876f5b27271 req-5b6e9c7e-fb04-471d-ab90-3c712cc93773 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079400 Aug 09 11:27:26.778576 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 121/231] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:26.781597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-16a6f0a3-1b3a-4531-b92b-56016241d3c3 req-7d5e8334-076d-489b-9d4d-7e4ab4abc7de service nova] Creating event network-changed:a3382375-d160-4e36-a97c-911aa245b179 for instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 on hv-cinder-84989 Aug 09 11:27:26.787076 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-16a6f0a3-1b3a-4531-b92b-56016241d3c3 req-7d5e8334-076d-489b-9d4d-7e4ab4abc7de service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090377 Aug 09 11:27:26.788125 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 111/232] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:27.298118 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:27.298850 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:27.300925 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:27.310568 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:27.311140 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:27.311762 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:27.312724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:27.313250 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:27.314188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:27.353382 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:27.355250 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:27.362900 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:27.363642 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:27.364374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:27.365927 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:27.367141 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:27.368879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:27.393646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:27.668971 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:27.673708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:27.677466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2e2bf5f9-7227-40d1-8941-6323a0f8f32b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.329010 Aug 09 11:27:27.678241 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 112/233] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:27 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:27.682176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d08f6d63-acaf-4d4f-853e-7da6585bdda0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.387475 Aug 09 11:27:27.683003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 122/234] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:27 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:27.696216 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:27.696824 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:27.704191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:27.704674 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:27.705098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:27.707394 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:27.707888 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:27.708322 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:27.910769 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:27.918831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0e5b56d9-8bb1-4aa7-96f1-f3bfa6d49003 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.239316 Aug 09 11:27:27.919661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 113/235] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:27 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:28.706935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:28.708247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:28.708876 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:28.709657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:28.712122 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:28.719407 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.720403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.721064 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:28.722059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.723074 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.723717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:28.728918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.729838 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.730296 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:28.731032 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.731479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.731900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:28.943949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:28.951379 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:28.959299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bbde168a-3466-4c27-a457-f751be237ed3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.260433 Aug 09 11:27:28.959605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-20c28ffe-4efb-4da8-918b-32618e5fc6a5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.256738 Aug 09 11:27:28.960213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 114/236] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:28 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:28.960621 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 123/237] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:28 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:28.975004 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:28.975004 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:28.975004 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.975381 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.976967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:28.978088 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:28.978850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:28.979580 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:29.127658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:29.135967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-20ff0ffb-354b-48ec-a29e-199ca71c736a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.174673 Aug 09 11:27:29.136562 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 115/238] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:28 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:29.991254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:29.992264 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:29.995849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:29.998630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:29.999616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:30.001736 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:30.002401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:30.003243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:30.003985 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:30.004430 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:30.007908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:30.008651 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:30.009875 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:30.010859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:30.011580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:30.012249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:30.584763 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:30.603803 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-38d6616e-e89e-4b57-a695-be90e6e3769b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1313 microversion: 2.1 time: 0.624712 Aug 09 11:27:30.604429 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:30.604775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 116/239] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:29 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:30.619701 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f820b5ad-845b-419f-808a-9f185389b742 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.641607 Aug 09 11:27:30.620239 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 124/240] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:29 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:30.622647 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:30.625371 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:30.634223 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:30.634720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:30.635196 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:30.635897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:30.636355 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:30.636777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:30.943576 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:30.952107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2d6c5030-4b08-4b8d-b14f-367a414a91e8 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.339572 Aug 09 11:27:30.952795 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 117/241] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:30 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:31.631672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:31.632812 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:31.641829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:31.643080 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:31.645574 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:31.654271 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:31.656192 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:31.658240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:31.658938 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:31.659171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:31.659805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:31.660032 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:31.660249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:31.661103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:31.661733 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:31.662324 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:31.670459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:31.945654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:31.953896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8d7f2f8f-b067-46ec-9438-028334d82369 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.315867 Aug 09 11:27:31.967953 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 118/242] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:31 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:31.975262 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:31.976103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:31.994596 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:31.995282 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:31.995805 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:31.996609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:31.997200 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:31.997712 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:32.034614 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:32.049433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-52d96371-f8d0-4596-bb14-6e3fb6bd3cde tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1496 microversion: 2.1 time: 0.427784 Aug 09 11:27:32.052679 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 125/243] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:31 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1496 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:32.229752 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:32.248175 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5384786b-c6d7-4c11-a4c6-13b2a9f1f629 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.278884 Aug 09 11:27:32.249231 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 119/244] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:31 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:32.992086 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:32.992693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:32.994899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:32.995972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=14 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:33.001421 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:33.002313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:33.003037 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:33.004128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:33.004856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:33.005593 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:33.162063 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:33.171814 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-931cba88-0ec9-4290-adbc-5c82b27d223c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.183643 Aug 09 11:27:33.174035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 126/245] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:32 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:33.269612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:33.270225 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:33.279451 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:33.280160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:33.280746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:33.281758 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:33.282364 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:33.283259 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:33.467406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:33.467935 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:33.486592 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:33.487143 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:33.487663 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:33.488697 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:33.489217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:33.489798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:33.538305 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:33.538540 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:27:33.575323 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e7eb8db7-6e3c-4ed6-9a6d-019b604cc398 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.309493 Aug 09 11:27:33.575947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 120/246] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:33 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:33.684035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c9a3420f-7238-420f-a389-06f08501693d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 204 len: 0 microversion: 2.1 time: 0.220417 Aug 09 11:27:33.685361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 127/247] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:27:33 2022] DELETE /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:27:33.695483 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:33.696400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:33.702669 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:33.703656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:33.704180 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:33.704969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:33.705512 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:33.706169 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:33.854551 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:33.862337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7ffdbf9b-7f41-4513-bcf1-dd8dd8594e96 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.171899 Aug 09 11:27:33.862969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 121/248] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:33 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:34.193804 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:34.194666 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:34.202010 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:34.202842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:34.203635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:34.204862 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:34.205753 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:34.206459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:34.368280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:34.375777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1f224677-51d3-4fe7-bf03-0724be169d0c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.186356 Aug 09 11:27:34.376347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 128/249] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:34 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:34.432947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fbf6e056-d787-49ad-8c82-0ec61ab4b0e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'create', calling method: .version_select at 0x7fece26a9160>, body: {"keypair": {"name": "tempest-keypair-1897874492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZp2FFmlZHx4sAr8ClHeIIBhwIKr5+FTx799BgdVA44B96SUV15j6xqAE4IDzRm98x3vh+4CspNFEq5JAszFPaNKZRjj7AopikZty32v4ESywomQa8zB4gK5oJbxoUhyg=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:34.448720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-fbf6e056-d787-49ad-8c82-0ec61ab4b0e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Getting quotas for project 001b779aebf8445eba01022c8c9abe19. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:27:34.452785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-fbf6e056-d787-49ad-8c82-0ec61ab4b0e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Getting quotas for user 0f80c1f4f2d04a9b80ab0c315dfe180d and project 001b779aebf8445eba01022c8c9abe19. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:27:34.479646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fbf6e056-d787-49ad-8c82-0ec61ab4b0e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218333 Aug 09 11:27:34.480483 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 122/250] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:27:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:27:34.605580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:34.606240 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:34.613810 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:34.614311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:34.614753 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:34.615569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:34.616015 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:34.616441 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:34.779310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:34.787975 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-320400c5-c1d8-4384-acf6-e6a24052276a tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.196195 Aug 09 11:27:34.788757 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 129/251] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:34 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:34.883841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:34.884455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:34.893720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:34.894191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:34.894987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:34.895821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:34.896589 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:34.897157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:35.105543 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:35.117286 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1aad05bd-dc95-46da-9201-b85f7c8eea75 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.237228 Aug 09 11:27:35.117852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 123/252] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:34 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:35.397225 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:35.397795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:35.404006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:35.404493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:35.404923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:35.405866 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:35.406852 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:35.408082 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:35.556649 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:35.564292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b0e6756d-0b1f-46ad-8d97-9ced212b1978 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.171302 Aug 09 11:27:35.564878 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 130/253] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:35 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:35.809350 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:35.810177 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:35.816819 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:35.817323 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:35.817749 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:35.818445 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:35.818919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:35.819347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:35.964594 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:35.976499 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-90c133d2-842e-4f00-b6f6-e10102ae97cd tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.171088 Aug 09 11:27:35.977086 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 124/254] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:35 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:36.146003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:36.146618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:36.153842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:36.154318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:36.154768 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:36.155472 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:36.155922 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:36.156342 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:36.182041 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2144365149", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c80e08a-f8a9-4469-a335-5361a8e5ac82"}], "security_groups": [{"name": "tempest-securitygroup--1676857318"}], "key_name": "tempest-keypair-1897874492", "user_data": "}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:36.341485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] validate_networks() for [('2c80e08a-f8a9-4469-a335-5361a8e5ac82', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:27:36.418208 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:36.430518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-37e404bd-9ee4-42d7-935a-af234e97a52e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.288493 Aug 09 11:27:36.436160 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 131/255] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:36 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:36.589493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:36.591011 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:36.598685 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:36.599520 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:36.600220 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:36.601273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:36.602387 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:36.603122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:36.843505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:36.852056 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b399d98c-8487-41ee-82c4-ef88c509c16b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.269921 Aug 09 11:27:36.865426 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 132/256] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:36 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:36.865720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:27:36.865720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:27:36.865720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:27:36.865720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:27:36.865720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:27:36.868243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:36.868814 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:36.869316 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:36.870103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:36.870622 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:36.871147 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:36.889573 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Getting quotas for project 001b779aebf8445eba01022c8c9abe19. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:27:36.893627 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Getting quotas for user 0f80c1f4f2d04a9b80ab0c315dfe180d and project 001b779aebf8445eba01022c8c9abe19. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:27:36.905146 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:27:36.907482 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:27:36.957578 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c34ff448-15ec-4843-9b9b-38abcbf3c4ab tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779873 Aug 09 11:27:36.962991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 125/257] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:27:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:27:36.970730 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-50fd2f59-13c2-4353-aa7b-66c84597dbee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:36.971672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-50fd2f59-13c2-4353-aa7b-66c84597dbee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:37.003687 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:37.007279 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:37.023330 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:37.023830 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:37.026664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:37.027507 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:37.027981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:37.034917 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:37.040077 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-50fd2f59-13c2-4353-aa7b-66c84597dbee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:37.049682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-50fd2f59-13c2-4353-aa7b-66c84597dbee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1238 microversion: 2.1 time: 0.082667 Aug 09 11:27:37.051060 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 133/258] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:36 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:37.212573 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:37.220294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3227bc33-54e0-43cd-a0b8-416629665594 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.224185 Aug 09 11:27:37.221104 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 126/259] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:36 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:37.453403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:37.454267 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:37.462103 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:37.462720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:37.463332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:37.464311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:37.464861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:37.465378 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:37.602961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:37.610843 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-169904fe-8232-4582-b58d-2099ee56f7c2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.161412 Aug 09 11:27:37.611513 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 134/260] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:37 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:37.873780 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:37.874490 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:37.881993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:37.882485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:37.882949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:37.883658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:37.884105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:37.884521 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:38.022778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:38.033449 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d6dcdf47-3e72-4eaf-8b57-57cec3ac8ff4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.163505 Aug 09 11:27:38.034056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 127/261] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:37 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:38.075652 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:38.076320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:38.083005 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:38.083543 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:38.083973 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:38.084689 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:38.085144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:38.085568 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:38.153870 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:38.162167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bb20d2a4-aa72-40ef-a9d1-fb0da3a36721 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1242 microversion: 2.1 time: 0.090469 Aug 09 11:27:38.162750 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 135/262] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:38 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:38.242402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:38.242950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:38.250583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:38.251186 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:38.251617 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:38.252322 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:38.253124 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:38.253719 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:38.395500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:38.408422 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-57d85415-b1b4-462f-881a-851f4e056037 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.170174 Aug 09 11:27:38.409564 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 128/263] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:38 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:38.632446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:38.633156 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:38.639498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:38.639978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:38.640450 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:38.641148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:38.641597 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:38.642017 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:38.781439 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:38.794998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cc2ea013-26ce-4bd4-8555-9882e0762301 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.166517 Aug 09 11:27:38.804336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 136/264] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:38 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:39.054791 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:39.055396 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:39.061894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:39.062393 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:39.062841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:39.063533 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:39.063985 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:39.064529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:39.183791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:39.184640 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:39.192341 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:39.192820 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:39.193252 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:39.193968 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:39.194415 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:39.194848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:39.207111 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:39.214785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e8e4f322-cc01-437e-ae06-b6548514fd5f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.164411 Aug 09 11:27:39.215456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 129/265] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:39 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:39.260841 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:39.268493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7ab4665d-1390-4a38-a830-b3f513b94c5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1290 microversion: 2.1 time: 0.089132 Aug 09 11:27:39.269140 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 137/266] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:39 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:39.432040 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:39.432692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:39.440097 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:39.440676 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:39.441114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:39.441801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:39.442242 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:39.442659 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:39.460506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:39.582764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:39.590404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4a698241-4f8a-4d43-bc3d-2c34a0c01ccf tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.164359 Aug 09 11:27:39.591036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 130/267] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:39 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:39.819120 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:39.820080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:39.827511 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:39.828016 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:39.828669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:39.829669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:39.830122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:39.830516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:39.969968 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:39.980962 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-16d22025-7c9f-4ff0-b321-1e66f8823d00 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.166772 Aug 09 11:27:39.981558 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 138/268] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:39 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:40.239117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:40.240003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:40.249975 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:40.250627 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:40.251377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:40.252418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:40.253249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:40.253700 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:40.289854 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:40.290361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:40.299203 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:40.299774 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:40.300278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:40.300993 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:40.301407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:40.301827 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:40.379672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:40.387985 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-417ffdac-a82d-4957-a905-7dab90e2bae5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1290 microversion: 2.1 time: 0.101965 Aug 09 11:27:40.388562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 139/269] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:40 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:40.414307 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:40.422335 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-437805eb-75ed-4a31-944e-5261fb193793 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.189210 Aug 09 11:27:40.423034 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 131/270] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:40 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:40.611955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:40.612613 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:40.619214 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:40.619698 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:40.620131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:40.620823 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:40.621271 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:40.621693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:40.758406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:40.766347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-70d31326-cbac-449d-a314-9badb1e48054 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.158442 Aug 09 11:27:40.766924 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 140/271] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:40 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:41.004018 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:41.004639 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:41.010901 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:41.011386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:41.011812 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:41.012499 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:41.012943 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:41.013354 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:41.155938 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:41.163802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-77e9e891-6199-46a4-9482-b3839b9ffe7d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.164946 Aug 09 11:27:41.164351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 132/272] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:40 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:41.410505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:41.411347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:41.420565 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:41.421252 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:41.421855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:41.422845 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:41.423522 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:41.424126 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:41.428512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:41.443842 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:41.444567 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:41.451698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:41.452182 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:41.452593 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:41.453285 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:41.453728 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:41.454143 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:41.494087 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:41.503882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b5038082-b35b-4f71-8693-58e4a43bf084 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1290 microversion: 2.1 time: 0.098806 Aug 09 11:27:41.504458 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 141/273] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:41 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:41.599919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:41.611649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9a33023f-daa6-4ee9-93e1-e57552b48d58 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.171678 Aug 09 11:27:41.612540 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 133/274] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:41 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:41.788801 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:41.789298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:41.795848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:41.796331 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:41.796760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:41.797446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:41.797895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:41.798312 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:41.930432 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:41.941631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-982ba5f6-bef8-4f47-a0e8-98b2b523e347 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.156926 Aug 09 11:27:41.942173 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 142/275] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:41 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:42.185532 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:42.186123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:42.193276 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:42.193276 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:42.193478 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:42.194188 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:42.194647 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:42.195101 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:42.350501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:42.358251 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-104a9c28-8456-4516-8997-acf5376fef8c tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.176615 Aug 09 11:27:42.358958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 134/276] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:42 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:42.532943 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:42.533537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:42.540273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:42.540754 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:42.541186 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:42.541886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:42.542334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:42.542762 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:42.604287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:42.612191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c81cbb47-7c5a-4268-ae66-529799a2e7fe tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1290 microversion: 2.1 time: 0.085132 Aug 09 11:27:42.612814 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 143/277] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:42 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:42.633026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:42.633637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:42.640550 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:42.641040 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:42.641435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:42.642162 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:42.642619 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:42.643089 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:42.775326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:42.783036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-49f1904a-59f1-4b44-b675-a1f1562056e3 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.153914 Aug 09 11:27:42.783575 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 135/278] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:42 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:42.962728 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:42.963265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:42.969827 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:42.970301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:42.970762 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:42.971484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:42.972295 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:42.972712 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:43.108524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:43.116857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bba35b6b-eef4-48a2-bc37-7ca3127e0ad3 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.158026 Aug 09 11:27:43.117433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 144/279] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:42 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:43.380131 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:43.380814 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:43.387336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:43.387826 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:43.388715 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:43.388827 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-f01a5c80-db1b-4867-9a81-fcd4c081137f req-0a44f87b-a5ed-4491-9f62-255c59831a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eadd8a-1b15-4226-8c0f-98d8a7687f52", "name": "network-vif-plugged", "status": "completed", "tag": "a3382375-d160-4e36-a97c-911aa245b179"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:43.388967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:43.389477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:43.389815 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:43.398755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f01a5c80-db1b-4867-9a81-fcd4c081137f req-0a44f87b-a5ed-4491-9f62-255c59831a64 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:43.399543 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f01a5c80-db1b-4867-9a81-fcd4c081137f req-0a44f87b-a5ed-4491-9f62-255c59831a64 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:43.400024 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f01a5c80-db1b-4867-9a81-fcd4c081137f req-0a44f87b-a5ed-4491-9f62-255c59831a64 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:43.417473 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-f01a5c80-db1b-4867-9a81-fcd4c081137f req-0a44f87b-a5ed-4491-9f62-255c59831a64 service nova] Creating event network-vif-plugged:a3382375-d160-4e36-a97c-911aa245b179 for instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 on hv-cinder-84989 Aug 09 11:27:43.422732 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-f01a5c80-db1b-4867-9a81-fcd4c081137f req-0a44f87b-a5ed-4491-9f62-255c59831a64 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038359 Aug 09 11:27:43.423673 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 145/280] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:27:43.528045 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:43.535829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-db62b56a-53dc-4b4b-b61d-662a61d6861b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.159700 Aug 09 11:27:43.536385 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 136/281] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:43 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:43.634879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:43.635554 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:43.642791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:43.643334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:43.643813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:43.644507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:43.644959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:43.645356 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:43.715043 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:43.724295 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cbe0f9d2-b968-4b3b-ba66-f9c0d80d1e71 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1298 microversion: 2.1 time: 0.094358 Aug 09 11:27:43.724877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 146/282] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:43 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:43.804107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:43.804699 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:43.811774 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:43.812208 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:43.812638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:43.813339 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:43.813770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:43.814191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:43.961965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:43.970646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9599365e-4669-45ea-9fb0-1be8b4e3b6cb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.170503 Aug 09 11:27:43.971278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 137/283] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:43 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:44.137845 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:44.138455 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:44.144475 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:44.144954 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:44.145382 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:44.146069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:44.146518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:44.146971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:44.295636 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:44.303922 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bc99afe3-b323-4ce0-abd4-445dd54da0bc tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.169888 Aug 09 11:27:44.304616 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 147/284] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:44 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:44.557229 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:44.557765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:44.564105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:44.564782 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:44.565215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:44.565918 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:44.566407 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:44.566846 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:44.743456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:44.747700 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:44.748320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:44.752267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c068f90d-83b7-4140-9b95-3ee6f3f957b6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1502 microversion: 2.1 time: 0.198971 Aug 09 11:27:44.752975 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 138/285] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:44 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:44.757108 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:44.757580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:44.758033 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:44.758757 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:44.759694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:44.760181 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:44.822787 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:44.830342 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-28941c6f-5d10-4779-ac76-9a7e81542990 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1296 microversion: 2.1 time: 0.086417 Aug 09 11:27:44.830928 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 148/286] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:44 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:44.992721 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:44.993103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:45.000753 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.000753 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.000942 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-3afbf9fd-bb48-4302-92f6-f4afd2049a7f req-2fea3ee6-99d6-41e1-a00d-0c62db0454c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2cd59e-1c76-4662-ac8a-7aa8e6b98959", "name": "network-vif-deleted", "tag": "61e76c94-8519-40ac-8891-9ab85eb72af5"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:45.001041 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.001835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.002377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.002921 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.010698 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3afbf9fd-bb48-4302-92f6-f4afd2049a7f req-2fea3ee6-99d6-41e1-a00d-0c62db0454c7 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.011199 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3afbf9fd-bb48-4302-92f6-f4afd2049a7f req-2fea3ee6-99d6-41e1-a00d-0c62db0454c7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.011629 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3afbf9fd-bb48-4302-92f6-f4afd2049a7f req-2fea3ee6-99d6-41e1-a00d-0c62db0454c7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.023306 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-3afbf9fd-bb48-4302-92f6-f4afd2049a7f req-2fea3ee6-99d6-41e1-a00d-0c62db0454c7 service nova] Creating event network-vif-deleted:61e76c94-8519-40ac-8891-9ab85eb72af5 for instance ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 on hv-cinder-84989 Aug 09 11:27:45.028273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-3afbf9fd-bb48-4302-92f6-f4afd2049a7f req-2fea3ee6-99d6-41e1-a00d-0c62db0454c7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031946 Aug 09 11:27:45.028858 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 149/287] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:27:45.136886 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:45.144932 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9bedd763-9e2c-4e27-b2dd-269cb44d57af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.156777 Aug 09 11:27:45.145496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 139/288] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:44 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:45.325502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:45.326232 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:45.332768 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.333254 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.333681 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.334374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.334837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.335272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.483213 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:45.493244 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b7840c11-10f4-4011-8df8-17b9708cf759 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.171214 Aug 09 11:27:45.494202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 150/289] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:45 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:45.774390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:45.775103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:45.781459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.781949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.782420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.783145 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.783811 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.784198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.853365 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:45.854078 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:45.861833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.862454 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.863084 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.863852 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.864390 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.865044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.932790 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:45.941008 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-02341481-c07f-4b3b-9428-980804977cd4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1296 microversion: 2.1 time: 0.091400 Aug 09 11:27:45.941911 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 151/290] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:45 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:45.966611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:45.967326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:45.967776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:45.968239 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lazy-loading 'fault' on Instance uuid ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:27:46.017181 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:46.026314 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-63cb4f55-374f-4e05-9724-a9a323b510a0 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1303 microversion: 2.1 time: 0.256376 Aug 09 11:27:46.027241 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 140/291] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:45 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:46.166097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:46.166790 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:46.173320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:46.173897 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:46.174337 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:46.175205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:46.175623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:46.176043 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:46.340764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:46.349452 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1d8455d2-4171-4c26-9c34-06412ab6e29a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.187423 Aug 09 11:27:46.350021 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 152/292] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:46 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:46.513930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:46.514665 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:46.522273 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:46.522744 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:46.523240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:46.523927 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:46.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:46.525146 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:46.880204 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:46.903786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=10 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:46.955091 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:46.961999 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:46.963432 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3e54f590-ba0a-4dff-bfdc-68af37284351 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1315 microversion: 2.1 time: 0.453317 Aug 09 11:27:46.963570 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:46.964091 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 141/293] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:46 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:46.969844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:46.970349 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:46.971156 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:46.971492 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:46.972473 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:46.973042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:47.043007 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-f88d2fcc-b2d5-45fe-9d04-bfc346b86139 req-70fca0f6-847e-4850-ac2a-82eec324f02f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26bbe60e-21bf-4703-8873-5190575e1ec9", "tag": "a8812474-eb48-4bb8-8c0f-cf18de6d6ba5"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:47.046345 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:47.054090 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f88d2fcc-b2d5-45fe-9d04-bfc346b86139 req-70fca0f6-847e-4850-ac2a-82eec324f02f service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:47.054570 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f88d2fcc-b2d5-45fe-9d04-bfc346b86139 req-70fca0f6-847e-4850-ac2a-82eec324f02f service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:47.055024 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f88d2fcc-b2d5-45fe-9d04-bfc346b86139 req-70fca0f6-847e-4850-ac2a-82eec324f02f service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:47.066451 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-f88d2fcc-b2d5-45fe-9d04-bfc346b86139 req-70fca0f6-847e-4850-ac2a-82eec324f02f service nova] Creating event network-changed:a8812474-eb48-4bb8-8c0f-cf18de6d6ba5 for instance 26bbe60e-21bf-4703-8873-5190575e1ec9 on hv-cinder-84989 Aug 09 11:27:47.071876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-f88d2fcc-b2d5-45fe-9d04-bfc346b86139 req-70fca0f6-847e-4850-ac2a-82eec324f02f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032567 Aug 09 11:27:47.072857 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 142/294] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:27:47.078105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:47.078792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:47.085208 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:47.085692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:47.086149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:47.086858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:47.087333 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:47.087748 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:47.110346 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:47.118111 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0a4ce35d-4627-4f8c-ae73-e4b9c82249c5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.160388 Aug 09 11:27:47.118600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:47.118703 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 153/295] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:46 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:47.119121 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:47.119593 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:47.120000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lazy-loading 'fault' on Instance uuid ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:27:47.164099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:47.171756 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b8286661-9ae6-497f-8fa0-96c9039c2d9e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 200 len: 1303 microversion: 2.1 time: 0.097678 Aug 09 11:27:47.172324 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 143/296] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:47 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:47.372911 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:47.373679 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:47.381654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:47.382371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:47.382821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:47.383533 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:47.384190 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:47.384616 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:47.518857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:47.527172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a23864dd-82dd-4641-9210-bf97b59062af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.160199 Aug 09 11:27:47.527736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 154/297] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:47 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:47.986058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:47.986671 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:47.994159 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:47.994681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:47.995152 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:47.996116 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:47.996612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:47.997226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.140133 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:48.141799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:48.148857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.149741 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.150507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.151473 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.152111 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.152754 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.155893 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:48.163667 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-708d1d99-147b-4dc9-bf90-427ab5a755c6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1465 microversion: 2.1 time: 0.181499 Aug 09 11:27:48.164242 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 144/298] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:47 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1465 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:48.202801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:48.204471 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: ae2cd59e-1c76-4662-ac8a-7aa8e6b98959] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:48.217374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.219256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.219695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.220422 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.220874 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.221298 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.242539 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] HTTP exception thrown: Instance ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 could not be found. Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Request method failure captured: Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 HTTP/1.1 Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kSMlz0A_5rVEJqnqWE9QuHo67cvXm3wnRQdePaHdUqN9jkfYuzOGxlVJ2C2EsDMaTb3sVYAAgPALklMAzF_uv9qnRf_tSVuVDk0VSvREcerTPyQsT7ZUbiDOJiBclXYPEAjbAaRFwJMIKCpArHjvkROgj1WcPlKNnNhKM7-X1Bl2Xo Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: bfc240016ba8447da04bbf7804e3d801 Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesActionsTest-1151995716 Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:27:48.244278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bfc240016ba8447da04bbf7804e3d801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bfc240016ba8447da04bbf7804e3d801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bfc240016ba8447da04bbf7804e3d801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bfc240016ba8447da04bbf7804e3d801", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesActionsTest-1151995716 Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: bfc240016ba8447da04bbf7804e3d801 Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesActionsTest-1151995716 Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesActionsTest-1151995716-project Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 20fa4a9037534826bb11e503c20b4dcb Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesActionsTest-1151995716-project Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 could not be found. Aug 09 11:27:48.245852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'ae2cd59e-1c76-4662-ac8a-7aa8e6b98959'} Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 could not be found. Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:27:48.246726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 could not be found. Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 could not be found. Aug 09 11:27:48.248171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:27:48.249472 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Returning 404 to user: Instance ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:27:48.249472 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7012c2a9-3ee8-4c3f-9df3-4a19f14c6ee2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959" status: 404 len: 111 microversion: 2.1 time: 0.049148 Aug 09 11:27:48.249472 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 145/299] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:48 2022] GET /compute/v2.1/servers/ae2cd59e-1c76-4662-ac8a-7aa8e6b98959 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:27:48.251617 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:48.252107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:48.261716 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.262207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.262634 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.263370 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.263801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.264219 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.293374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:27:48.333170 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:48.348270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:48.370130 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a8ed6622-6f0c-4556-9365-f973850646f7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.224342 Aug 09 11:27:48.370130 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 155/300] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:48 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:48.389412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:48.397851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2c4193d5-4eb3-45b4-8308-d0a62f193afb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "DELETE /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 204 len: 0 microversion: 2.1 time: 0.150072 Aug 09 11:27:48.398523 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 146/301] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:27:48 2022] DELETE /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:27:48.407518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:48.408132 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:48.408401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-370874418", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "networks": [{"uuid": "1bb8f388-3f80-4d6b-aae2-3975dc034a06"}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:48.414727 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.415252 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.415685 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.416409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.416867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.417313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.468849 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] validate_networks() for [('1bb8f388-3f80-4d6b-aae2-3975dc034a06', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:27:48.638333 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:48.646877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7f66282a-55b9-457d-a01a-56fd093d9c3c tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.243703 Aug 09 11:27:48.653786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 156/302] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:48 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:48.654858 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:48.655507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:48.661837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.662296 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.662745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.663481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.663939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.664364 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.904663 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:48.914278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-61757326-1738-434a-9251-3ddf587fb8fb tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.264836 Aug 09 11:27:48.915016 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 157/303] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:48 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:48.942999 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:27:48.943425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:27:48.943897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:27:48.944301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:27:48.944833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:27:48.953841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.954319 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.954747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.955506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:48.955960 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:48.956378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:48.973763 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Getting quotas for project bfc240016ba8447da04bbf7804e3d801. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:27:48.977966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Getting quotas for user 20fa4a9037534826bb11e503c20b4dcb and project bfc240016ba8447da04bbf7804e3d801. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:27:48.989262 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:27:48.991669 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:27:49.038605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fd40fb17-0033-4b3b-b161-97b536ac6836 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634429 Aug 09 11:27:49.039318 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 147/304] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:27:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 11:27:49.050199 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b96eb234-ab9c-4cad-bd5e-651bff1baeb2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:49.050683 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b96eb234-ab9c-4cad-bd5e-651bff1baeb2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:49.103326 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b96eb234-ab9c-4cad-bd5e-651bff1baeb2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:49.110184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b96eb234-ab9c-4cad-bd5e-651bff1baeb2 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1213 microversion: 2.1 time: 0.064093 Aug 09 11:27:49.110762 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 158/305] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:49 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:49.381468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:49.382549 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:49.389627 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:49.390109 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:49.390658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:49.391245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:49.391736 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:49.392143 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:49.532940 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:49.544770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5e7197bd-0c45-48fe-ad2c-0537e86ce69d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.168063 Aug 09 11:27:49.545563 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 148/306] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:49 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:49.671731 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:49.672309 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:49.678873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:49.679409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:49.679833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:49.680511 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:49.680959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:49.681379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:49.824004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:49.831772 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-665bc861-2eb8-4b5c-bafe-765e30994d02 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.163980 Aug 09 11:27:49.832320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 159/307] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:49 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:49.938063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:49.943483 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:49.945329 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:49.945821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:49.946286 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:49.947045 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:49.947484 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:49.947926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:50.092381 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:50.102268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0fe96def-9ca5-4b51-adb0-3e725bc962c1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.169738 Aug 09 11:27:50.102850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 149/308] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:49 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:50.131144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:50.131851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:50.138212 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:50.138695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:50.139156 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:50.139851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:50.140301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:50.140750 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:50.144626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:50.209699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:50.221489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-787e90fd-6757-4730-91f0-75b9197e170b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1217 microversion: 2.1 time: 0.094095 Aug 09 11:27:50.222762 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 160/309] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:50 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:50.569113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:50.569705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:50.577885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:50.578923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:50.578923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:50.579796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:50.580330 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:50.580821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:50.720587 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:50.728888 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-567b4622-181e-43bc-b760-b87e4bae01c0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.164509 Aug 09 11:27:50.729488 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 150/310] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:50 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:50.856740 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:50.857364 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:50.866676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:50.867298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:50.867882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:50.868824 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:50.869310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:50.869837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.011088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:51.021729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-16ba54dc-9d6c-4ead-88da-b0e7304f47a9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.170997 Aug 09 11:27:51.022298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 161/311] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:50 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:51.122690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:51.123335 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:51.130108 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.130872 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.131351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.132126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.132614 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.133056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.243564 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:51.244262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:51.251094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.251581 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.252036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.252714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.253175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.253624 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.269519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:51.277478 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cf59af24-3c46-4c32-a5bb-3b60e9515584 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.158651 Aug 09 11:27:51.278038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 151/312] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:51 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:51.314663 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:51.322620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e7458144-acbe-4050-8475-899b62c535fa tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1217 microversion: 2.1 time: 0.082972 Aug 09 11:27:51.323236 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 162/313] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:51 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:51.750576 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:51.751165 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:51.758213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.758703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.759159 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.759861 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:51.760307 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:51.760724 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:51.908164 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:51.916072 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4f47e2b6-0da7-44a4-92b2-81eb887bfb36 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.169360 Aug 09 11:27:51.916639 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 152/314] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:51 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:52.043678 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:52.044278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:52.050964 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.051456 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.051900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:52.052602 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.053059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.053486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:52.189721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:52.197938 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4a97abcb-a76d-4c12-a401-3e52666ff5ae tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.158401 Aug 09 11:27:52.198503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 163/315] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:52 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:52.299093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:52.299704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:52.306129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.306625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.307093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:52.307785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.308237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.308669 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:52.345337 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:52.345951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:52.352602 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.353296 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.353735 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:52.354430 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.354910 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.355573 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:52.439040 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:52.447141 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-be983a02-063c-4d21-af90-372805b2bc05 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1217 microversion: 2.1 time: 0.107021 Aug 09 11:27:52.447722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 164/316] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:52 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:52.469930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:52.478114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a9dc18c4-dc7e-4c49-b5fe-d90b90869217 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.182968 Aug 09 11:27:52.478696 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 153/317] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:52 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:52.937130 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:52.937759 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:52.944197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.944687 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.945097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:52.945905 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:52.946359 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:52.946782 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:53.094886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:53.103516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1633908f-31f0-46b8-bc65-55a9970870c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.170322 Aug 09 11:27:53.104131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 165/318] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:52 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:53.226963 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:53.227584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:53.234154 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:53.234628 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:53.235078 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:53.235766 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:53.236206 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:53.236615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:53.385619 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:53.395007 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a062517d-8b61-4497-875e-cb8ab7251c1d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.171987 Aug 09 11:27:53.395553 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 154/319] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:53 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:53.475237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:53.476017 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:53.484653 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:53.485162 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:53.485594 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:53.486298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:53.486752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:53.487294 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:53.499147 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:53.499846 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:53.506424 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:53.506940 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:53.507373 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:53.508105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:53.508748 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:53.509175 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:53.561218 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:53.569139 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4e77420d-6f04-4c1c-bf5a-7d50c151ee36 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1217 microversion: 2.1 time: 0.100432 Aug 09 11:27:53.569795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 166/320] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:53 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:53.652796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:53.660652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-36327de4-f8e7-41eb-b8a7-25f8fda69972 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.165511 Aug 09 11:27:53.661194 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 155/321] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:53 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:54.125900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:54.126781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:54.129305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:54.136319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.136838 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.137278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.137987 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.138443 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.138891 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.416014 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:54.417204 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:54.423985 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.424475 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.424896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.425581 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.426214 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.426640 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.445908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:54.458828 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9749fd2a-ff1e-4364-a5ae-a0ff0f5f33b9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.337013 Aug 09 11:27:54.459820 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 167/322] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:54 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:54.582711 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:54.592040 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-999ae893-2688-4d47-a5fa-36029663a63e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.179969 Aug 09 11:27:54.592721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:54.593329 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 156/323] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:54 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:54.599401 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:54.610350 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.610792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.611243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.611960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.612415 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.612864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.680739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:54.681560 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:54.682156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:54.688755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-92ff00c8-7d1c-4740-85e7-b148f8006a0a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1217 microversion: 2.1 time: 0.100929 Aug 09 11:27:54.689316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 168/324] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:54 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:54.692766 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.693254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.693679 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.694370 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:54.694829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:54.695356 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:54.827558 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:54.835793 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-dad0af3c-c479-4727-8522-e0b7c4f557a0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.158122 Aug 09 11:27:54.836337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 157/325] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:54 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:55.480593 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:55.481175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:55.487645 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.488204 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.488641 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:55.489573 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.490013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.490431 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:55.614919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:55.616089 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:55.623402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.624268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.624669 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:55.625605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.626057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.626480 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:55.637170 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:55.645246 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2a0cceac-a89d-44a7-a28f-81829c6bc339 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.168483 Aug 09 11:27:55.646065 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 169/326] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:55 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:55.710068 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:55.711123 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:55.729543 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.730329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.730786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:55.731513 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.731964 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.732384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:55.780861 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:55.788695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-020433ac-4ee4-4274-b809-042d27f82597 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.177761 Aug 09 11:27:55.789342 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 158/327] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:55 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:55.829812 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:55.838684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-73e68f24-33f7-4ec1-83d2-1ec142b7eae3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1217 microversion: 2.1 time: 0.132940 Aug 09 11:27:55.839296 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 170/328] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:55 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:55.864580 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:55.865189 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:55.871724 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.872188 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.872622 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:55.873332 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:55.873781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:55.874199 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:56.021620 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:56.029544 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-67c84178-f182-49f0-92f0-86a434872ba4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.169575 Aug 09 11:27:56.030099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 159/329] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:55 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:56.668097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:56.668778 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:56.675047 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:56.675541 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:56.675993 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:56.676704 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:56.677150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:56.677568 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:56.809824 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:56.810651 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:56.821411 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:56.822096 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:56.822530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:56.824633 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:56.825103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:56.825529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:56.832094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:56.843608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0e5beec5-b957-47f4-a952-340277548714 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.179508 Aug 09 11:27:56.844195 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 171/330] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:56 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:56.870497 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:56.871249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:56.877823 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:56.878304 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:56.878732 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:56.879658 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:56.879882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:56.880489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:56.958748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:56.969293 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-41e7fafe-0831-43cf-a0d3-2db7ba2b4d2d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1217 microversion: 2.1 time: 0.102133 Aug 09 11:27:56.969438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 172/331] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:56 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:57.000630 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:57.017482 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-42affa6f-2958-4d3d-be77-2afdd99c7477 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.211393 Aug 09 11:27:57.018086 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 160/332] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:56 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:57.051066 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:57.051829 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:57.064967 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:57.065488 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:57.065923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:57.066698 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:57.067127 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:57.067545 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:57.230678 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:57.238696 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4c3975f7-6abc-4fe2-a94d-fa83a15f8b01 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.191769 Aug 09 11:27:57.239305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 173/333] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:57 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:57.866335 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:57.867147 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:57.874053 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:57.874602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:57.875075 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:57.875766 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:57.876221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:57.876644 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:58.007710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:58.009019 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:58.009883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:58.016138 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:58.016404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-17149117-62aa-42b2-a0b3-7311a2b6d987 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.154071 Aug 09 11:27:58.016624 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:58.017228 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 161/334] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:57 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:58.017424 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:58.018369 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:58.018992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:58.019550 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:58.042291 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:58.043283 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:58.081277 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:58.083466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:58.085764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:58.088951 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:58.090837 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:58.095456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:58.114649 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:58.124759 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2d37673f-1f2a-43a6-a445-d6da1ff15569 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1217 microversion: 2.1 time: 0.120184 Aug 09 11:27:58.125328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 174/335] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:58 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:58.260351 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:58.261151 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:58.267955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:58.268558 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:58.270048 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:58.270879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:58.271588 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:58.272213 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:58.351529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:58.360279 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-70b456cc-7c18-4ae6-b196-ad482fa166f9 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.325290 Aug 09 11:27:58.361075 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 162/336] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:58 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:58.441377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:58.450578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b4179965-f786-4227-8c2a-3a1568abefe0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.194379 Aug 09 11:27:58.451879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 175/337] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:58 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:59.039796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:59.041110 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:59.047176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:59.048415 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:59.050425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:59.051198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:59.051774 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.052545 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:59.053226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:59.053710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.074468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:59.151305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:59.153010 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:59.155261 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:59.162868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:59.164089 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:59.164736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.165754 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:59.166598 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:59.170977 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.313537 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:59.325899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:59.327237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-00743a57-1ccb-476e-a074-79a26174c233 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.290428 Aug 09 11:27:59.333132 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:59.335810 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-67ca7938-521d-4bf0-b775-e3892b2a123f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1265 microversion: 2.1 time: 0.189344 Aug 09 11:27:59.338727 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 163/338] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:59 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:59.344942 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 176/339] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:59 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:27:59.381519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:59.382134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:59.388480 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:59.389517 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:59.390008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.390776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:59.391308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:59.391787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.473439 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:27:59.474185 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:27:59.486623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:59.487311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:59.487837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.488758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:59.489413 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:59.489903 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.590580 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:59.600579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2ad472bb-bb98-458b-83dd-8af05ea55e4e tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.223005 Aug 09 11:27:59.608664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 164/340] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:59 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:27:59.652222 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-cb4bc0a9-01e5-4baf-9454-7df2fedb38fc req-ed8a9274-4fb7-4431-97ad-90fa62600654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bbe60e-21bf-4703-8873-5190575e1ec9", "name": "network-vif-plugged", "status": "completed", "tag": "a8812474-eb48-4bb8-8c0f-cf18de6d6ba5"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:27:59.662546 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-cb4bc0a9-01e5-4baf-9454-7df2fedb38fc req-ed8a9274-4fb7-4431-97ad-90fa62600654 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:27:59.663053 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-cb4bc0a9-01e5-4baf-9454-7df2fedb38fc req-ed8a9274-4fb7-4431-97ad-90fa62600654 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:27:59.663673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-cb4bc0a9-01e5-4baf-9454-7df2fedb38fc req-ed8a9274-4fb7-4431-97ad-90fa62600654 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:27:59.683024 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:27:59.683538 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-cb4bc0a9-01e5-4baf-9454-7df2fedb38fc req-ed8a9274-4fb7-4431-97ad-90fa62600654 service nova] Creating event network-vif-plugged:a8812474-eb48-4bb8-8c0f-cf18de6d6ba5 for instance 26bbe60e-21bf-4703-8873-5190575e1ec9 on hv-cinder-84989 Aug 09 11:27:59.689176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-cb4bc0a9-01e5-4baf-9454-7df2fedb38fc req-ed8a9274-4fb7-4431-97ad-90fa62600654 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041089 Aug 09 11:27:59.689786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 165/341] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:27:59.692890 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5fc284aa-38a3-42b2-8e1d-9dfb7b356a5b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.224173 Aug 09 11:27:59.693561 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 177/342] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:27:59 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:00.360291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:00.361031 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:00.361163 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:00.361693 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:00.367530 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.367999 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.368291 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.368453 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:00.368738 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.369147 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.369303 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:00.369627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.369912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.370055 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:00.370471 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.371035 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:00.478991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:00.490534 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a3b7c431-b3b6-4ac9-bfe7-fa47ac14a3e8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1273 microversion: 2.1 time: 0.134101 Aug 09 11:28:00.491536 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 178/343] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:00 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:00.627714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:00.629354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:00.641667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.643064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.644124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:00.645646 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.646836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.647791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:00.673425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:00.695462 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cdd0513b-ecd5-412d-b806-213c2ea5b9d5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.338663 Aug 09 11:28:00.696750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 166/344] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:00 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:00.740015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:00.740885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:00.747931 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.748705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.749312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:00.753537 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:00.754435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:00.755121 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:01.125654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:01.134621 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-270ffbc4-00ea-4453-95cf-c86133ea0fad tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1471 microversion: 2.1 time: 0.515192 Aug 09 11:28:01.141451 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 179/345] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:00 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1471 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:01.155821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:01.166444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e0d0dd22-7c7c-4db7-8e31-a9713f3dd533 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.451547 Aug 09 11:28:01.175661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 167/346] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:00 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:01.512846 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:01.514125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:01.521368 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:01.522110 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:01.522707 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:01.523601 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:01.524060 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:01.524642 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:01.617947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-f957d6c7-07c3-404d-919b-d9cac54aaae1 req-30a886af-7da4-46f8-99a0-cb0d4139d1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eadd8a-1b15-4226-8c0f-98d8a7687f52", "name": "network-vif-deleted", "tag": "a3382375-d160-4e36-a97c-911aa245b179"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:01.642057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f957d6c7-07c3-404d-919b-d9cac54aaae1 req-30a886af-7da4-46f8-99a0-cb0d4139d1bb service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:01.644019 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f957d6c7-07c3-404d-919b-d9cac54aaae1 req-30a886af-7da4-46f8-99a0-cb0d4139d1bb service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:01.644545 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f957d6c7-07c3-404d-919b-d9cac54aaae1 req-30a886af-7da4-46f8-99a0-cb0d4139d1bb service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:01.649119 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:01.664982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-f957d6c7-07c3-404d-919b-d9cac54aaae1 req-30a886af-7da4-46f8-99a0-cb0d4139d1bb service nova] Creating event network-vif-deleted:a3382375-d160-4e36-a97c-911aa245b179 for instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 on hv-cinder-84989 Aug 09 11:28:01.666317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fe40773a-04ad-45e4-8f6d-8629e0af3cf8 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1271 microversion: 2.1 time: 0.156168 Aug 09 11:28:01.671291 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-f957d6c7-07c3-404d-919b-d9cac54aaae1 req-30a886af-7da4-46f8-99a0-cb0d4139d1bb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063990 Aug 09 11:28:01.677193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 168/347] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:28:01.680213 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 180/348] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:01 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:01.728977 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:01.730142 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-15f27218-d2e3-41a9-abb4-bc383f1dee40 req-62b9ea42-7ba9-4a9d-bcff-6031d0ef1956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eadd8a-1b15-4226-8c0f-98d8a7687f52", "name": "network-vif-unplugged", "status": "completed", "tag": "a3382375-d160-4e36-a97c-911aa245b179"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:01.731205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:01.744587 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-15f27218-d2e3-41a9-abb4-bc383f1dee40 req-62b9ea42-7ba9-4a9d-bcff-6031d0ef1956 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:01.745583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-15f27218-d2e3-41a9-abb4-bc383f1dee40 req-62b9ea42-7ba9-4a9d-bcff-6031d0ef1956 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:01.746179 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-15f27218-d2e3-41a9-abb4-bc383f1dee40 req-62b9ea42-7ba9-4a9d-bcff-6031d0ef1956 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:01.751454 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:01.752691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:01.753450 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:01.754324 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:01.755025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:01.755610 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:01.763848 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-15f27218-d2e3-41a9-abb4-bc383f1dee40 req-62b9ea42-7ba9-4a9d-bcff-6031d0ef1956 service nova] Creating event network-vif-unplugged:a3382375-d160-4e36-a97c-911aa245b179 for instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 on hv-cinder-84989 Aug 09 11:28:01.769881 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-15f27218-d2e3-41a9-abb4-bc383f1dee40 req-62b9ea42-7ba9-4a9d-bcff-6031d0ef1956 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045629 Aug 09 11:28:01.770806 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 169/349] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:01.901920 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:01.909623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bb804354-5a85-4f3e-a2fb-ec92f1990ee4 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.185700 Aug 09 11:28:01.910203 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 181/350] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:01 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:02.165459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:02.166241 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:02.175151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.175902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.176565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:02.177646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.178339 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.179033 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:02.198338 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:02.198978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:02.205322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.205820 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.206299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:02.206972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.207429 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.207845 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:02.273074 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:02.280892 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a62f6496-0f18-4563-b449-8c57d62377b6 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1429 microversion: 2.1 time: 0.121176 Aug 09 11:28:02.281484 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 170/351] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:02 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:02.362434 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:02.370381 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ecd51495-7635-4313-ba7d-272f777f557a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.176255 Aug 09 11:28:02.370970 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 182/352] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:02 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:02.698268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:02.698896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:02.705496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.705987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.706419 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:02.707151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.707616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.708027 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:02.853929 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:02.861730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bbb6f57e-05b6-41de-8fbf-0c5fbdbfdde5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.167472 Aug 09 11:28:02.862300 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 171/353] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:02 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:02.932360 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:02.932997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:02.939495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.939982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.940409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:02.941100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:02.941553 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:02.941982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:03.077359 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:03.085181 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8c9f42c8-b8ee-4061-968a-688486d1a90c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.156775 Aug 09 11:28:03.085748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 183/354] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:02 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:03.304334 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:03.304987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:03.313139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:03.313809 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:03.314303 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:03.315352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:03.315969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:03.316449 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:03.391378 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:03.391991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:03.398180 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:03.398670 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:03.398960 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:03.399172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:03.400187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:03.400349 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:03.400718 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:03.407007 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-33945dbf-3c72-47d8-9bdc-31e448f7e503 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1429 microversion: 2.1 time: 0.108508 Aug 09 11:28:03.414006 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 172/355] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:03 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:03.531383 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:03.539227 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-61bf0c61-72a1-4372-8a7a-c23d28dc431c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.151832 Aug 09 11:28:03.539752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 184/356] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:03 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:03.887910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:03.888528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:03.896459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:03.896993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:03.897437 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:03.898185 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:03.898670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:03.899174 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:04.052003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:04.061795 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3fff1823-7568-4419-b98b-9850c7e1674b tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.178195 Aug 09 11:28:04.062372 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 173/357] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:03 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:04.107102 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:04.107716 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:04.114146 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:04.114634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:04.115103 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:04.115774 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:04.116228 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:04.116650 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:04.248727 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:04.256866 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cddb2a4d-53e8-4e8c-b69c-d4386b15d1a2 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.153801 Aug 09 11:28:04.257465 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 185/358] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:04 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:04.429399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:04.430018 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:04.437436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:04.437939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:04.438379 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:04.439137 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:04.439592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:04.440022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:04.519122 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:04.529136 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ef060220-7c38-4866-aba0-390d1d8bb917 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1429 microversion: 2.1 time: 0.104019 Aug 09 11:28:04.529730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 174/359] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:04 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:04.560306 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:04.560907 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:04.567323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:04.567827 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:04.568251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:04.568937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:04.569354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:04.569823 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:04.716256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:04.725788 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-667a2a1c-de00-439c-9a07-9a0058985a24 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.169430 Aug 09 11:28:04.726352 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 186/360] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:04 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:05.083552 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:05.084201 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:05.091741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.092218 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.092643 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.093318 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.093776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.094220 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.223969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:05.231779 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-966d0446-1916-4121-a49e-979d826617f6 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.152498 Aug 09 11:28:05.232351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 175/361] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:05 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:05.277987 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:05.278722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:05.285396 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.285885 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.286312 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.287066 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.287518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.287945 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.424775 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:05.432620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-dc44bf82-220b-42a5-9763-896d474a45ec tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.158437 Aug 09 11:28:05.433193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 187/362] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:05 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:05.550750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:05.551391 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:05.558157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.558652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.559119 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.559835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.560293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.560718 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.635522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:05.643731 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8eeb5805-6274-4ef7-935f-316c8f048624 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1429 microversion: 2.1 time: 0.097359 Aug 09 11:28:05.644548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 176/363] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:05 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1429 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:05.747261 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:05.747874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:05.754512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.755027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.755465 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.756174 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:05.756627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:05.757106 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:05.893847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:05.901864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5e990750-b4a6-416a-bfb0-b174e6a0137d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.158689 Aug 09 11:28:05.902429 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 188/364] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:05 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:06.252884 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:06.253720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:06.260485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.260914 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.261338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:06.262046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.262485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.262925 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:06.454519 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:06.455167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:06.461841 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.462322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.462998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:06.463798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.464263 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.464939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:06.785254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:06.794055 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ad999b91-2074-4a74-810b-c4d6443a9ffc tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.544961 Aug 09 11:28:06.794757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 177/365] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:06 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:06.799600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:06.800399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:06.807078 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.807797 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.808309 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:06.809151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.809606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.810035 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:06.896732 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:06.901531 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:06.905495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8e9095c0-5f4b-4685-ae9d-ac89b1b58918 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1300 microversion: 2.1 time: 0.109386 Aug 09 11:28:06.906096 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 178/366] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:06 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:06.914659 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-204a7a37-5c4f-425e-821f-ed967b3c74ae tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1364 microversion: 2.1 time: 0.464613 Aug 09 11:28:06.915402 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 189/367] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:06 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1364 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:06.933060 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:06.933678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:06.940468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.940936 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.941377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:06.942139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:06.942633 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:06.943069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.151429 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:07.159275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-71c9e1ee-057e-4e7c-b9fa-5b80c0a7f138 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1523 microversion: 2.1 time: 0.230666 Aug 09 11:28:07.159851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 179/368] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:06 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:07.237146 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e67c507c-5a8b-4bfe-8ab3-b669b32b5a1c req-ec3e4a84-ebfe-48d2-bc26-cf68e99d39a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "356432f3-2475-4a32-9017-d095c516d414", "tag": "20c6af6b-bf87-427e-9768-c4e17bb50edc"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:07.247579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e67c507c-5a8b-4bfe-8ab3-b669b32b5a1c req-ec3e4a84-ebfe-48d2-bc26-cf68e99d39a3 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.248062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e67c507c-5a8b-4bfe-8ab3-b669b32b5a1c req-ec3e4a84-ebfe-48d2-bc26-cf68e99d39a3 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.248464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e67c507c-5a8b-4bfe-8ab3-b669b32b5a1c req-ec3e4a84-ebfe-48d2-bc26-cf68e99d39a3 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.263313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e67c507c-5a8b-4bfe-8ab3-b669b32b5a1c req-ec3e4a84-ebfe-48d2-bc26-cf68e99d39a3 service nova] Creating event network-changed:20c6af6b-bf87-427e-9768-c4e17bb50edc for instance 356432f3-2475-4a32-9017-d095c516d414 on hv-cinder-84989 Aug 09 11:28:07.270703 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e67c507c-5a8b-4bfe-8ab3-b669b32b5a1c req-ec3e4a84-ebfe-48d2-bc26-cf68e99d39a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036800 Aug 09 11:28:07.272456 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 190/369] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:07.815471 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:07.816019 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:07.822926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.823420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.823849 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.824593 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.825043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.825460 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.929047 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:07.929947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:07.936612 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.937098 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.937544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.938262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.938722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.939180 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.964643 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:07.971705 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.972183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.972619 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.972866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6a8f9989-98d3-4a74-9daa-25cde39b4f2f tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.161332 Aug 09 11:28:07.973064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lazy-loading 'fault' on Instance uuid 04eadd8a-1b15-4226-8c0f-98d8a7687f52 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:28:07.973445 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 180/370] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:07 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:07.984180 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:07.984620 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:07.991269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.992167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.992625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:07.993314 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:07.993765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:07.994226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:08.031073 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:08.039029 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aa02fd28-22fe-49e9-b12a-95f77e36f7eb tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1305 microversion: 2.1 time: 0.114161 Aug 09 11:28:08.039617 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 191/371] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:07 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:08.141325 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:08.150036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6c8e32e7-d483-4c7b-807d-0519a347790c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1549 microversion: 2.1 time: 0.170301 Aug 09 11:28:08.150643 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 181/372] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:07 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:08.171822 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-56010f22-86f4-40c7-9cbd-eb4c5ea78724 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:08.172306 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-56010f22-86f4-40c7-9cbd-eb4c5ea78724 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:08.180567 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:08.180983 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56010f22-86f4-40c7-9cbd-eb4c5ea78724 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:08.181192 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:08.181484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56010f22-86f4-40c7-9cbd-eb4c5ea78724 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:08.181897 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56010f22-86f4-40c7-9cbd-eb4c5ea78724 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:08.182720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56010f22-86f4-40c7-9cbd-eb4c5ea78724 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:08.183380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56010f22-86f4-40c7-9cbd-eb4c5ea78724 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:08.183836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-56010f22-86f4-40c7-9cbd-eb4c5ea78724 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:08.188193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:08.188670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:08.189113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:08.189848 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:08.190315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:08.190744 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:08.197314 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:08.330350 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-56010f22-86f4-40c7-9cbd-eb4c5ea78724 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162640 Aug 09 11:28:08.330970 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 192/373] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 11:28:08 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:08.413897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:08.423586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-987c2f7f-5fa0-43bd-9cd9-b2d9cbb0a068 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1503 microversion: 2.1 time: 0.246936 Aug 09 11:28:08.424294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 182/374] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:08 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:08.444908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:08.445530 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:08.453539 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:08.455112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:08.455112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:08.455409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:08.455665 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:08.456088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:08.602662 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:08.611636 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1368b123-57ef-4e0a-8e6d-b712a8c34f87 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1515 microversion: 2.1 time: 0.170815 Aug 09 11:28:08.612266 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 193/375] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:08 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:09.000243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:09.002394 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:09.016718 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:09.017513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:09.019009 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:09.019975 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:09.020633 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:09.021250 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:09.063334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:09.065187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:09.079471 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:09.079974 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:09.091269 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:09.092211 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:09.092721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:09.093175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:09.120814 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:09.144883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:09.145717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:09.146335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:09.147033 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lazy-loading 'fault' on Instance uuid 04eadd8a-1b15-4226-8c0f-98d8a7687f52 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:28:09.286060 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72941424337943908351c9d6c812ce97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fec1f5ba8ef43ba9a04a16e17b9ad6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:09.296137 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9b55c685-f055-4f28-a532-c5f6d3b08971 tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 200 len: 1305 microversion: 2.1 time: 0.238659 Aug 09 11:28:09.296722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 194/376] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:09 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 1305 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:09.477659 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:09.494142 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-63cf9879-a7c7-45a6-9c8f-b8d9e3925060 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.501607 Aug 09 11:28:09.495619 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 183/377] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:08 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:10.104805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-400c784e-f657-41e8-9692-a517261acf80 req-10ab9ece-531b-4c4a-b33f-4993ba6b2f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26bbe60e-21bf-4703-8873-5190575e1ec9", "tag": "a8812474-eb48-4bb8-8c0f-cf18de6d6ba5"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:10.115673 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-400c784e-f657-41e8-9692-a517261acf80 req-10ab9ece-531b-4c4a-b33f-4993ba6b2f3e service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:10.116223 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-400c784e-f657-41e8-9692-a517261acf80 req-10ab9ece-531b-4c4a-b33f-4993ba6b2f3e service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:10.116859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-400c784e-f657-41e8-9692-a517261acf80 req-10ab9ece-531b-4c4a-b33f-4993ba6b2f3e service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:10.139054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-400c784e-f657-41e8-9692-a517261acf80 req-10ab9ece-531b-4c4a-b33f-4993ba6b2f3e service nova] Creating event network-changed:a8812474-eb48-4bb8-8c0f-cf18de6d6ba5 for instance 26bbe60e-21bf-4703-8873-5190575e1ec9 on hv-cinder-84989 Aug 09 11:28:10.146397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:10.149059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:10.154803 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-400c784e-f657-41e8-9692-a517261acf80 req-10ab9ece-531b-4c4a-b33f-4993ba6b2f3e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054551 Aug 09 11:28:10.157459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 195/378] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:10.164062 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:10.164577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:10.165023 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:10.165771 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:10.166226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:10.166766 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:10.192978 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lazy-loading 'flavor' on Instance uuid f727a3f9-56c8-4305-bcd5-68f8d6d31f79 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:28:10.322537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:10.323596 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] [instance: 04eadd8a-1b15-4226-8c0f-98d8a7687f52] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:10.341297 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:10.341783 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:10.343805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:10.346615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3342e691-3cc6-4b17-bc86-c35494389756 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79/action" status: 200 len: 32 microversion: 2.1 time: 0.205709 Aug 09 11:28:10.347436 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:10.348065 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:10.348669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:10.351269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 184/379] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:28:10 2022] POST /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:28:10.377223 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:10.381389 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:10.397596 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] HTTP exception thrown: Instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 could not be found. Aug 09 11:28:10.398740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:10.399329 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:10.399757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:10.400480 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Request method failure captured: Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 HTTP/1.1 Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kSY30OuP7BKiomkUjlXVNM_44ss8r4IeQElqO8961FVgi3rBairDl6w1z-CBl3W_9UzEyoQFt9X7Zt3oqw-PsrISo7n3y483eyJ8yfQa2FZ5hyxsRIRLn5EWLRCXbSYTcgwq13XnXEp0Kn2IsCQRDwL8Wds6QTIBQcP4d8un4w1XKY Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 7fec1f5ba8ef43ba9a04a16e17b9ad6d Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesNegativeTest-1612100881 Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:28:10.403380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fec1f5ba8ef43ba9a04a16e17b9ad6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fec1f5ba8ef43ba9a04a16e17b9ad6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7fec1f5ba8ef43ba9a04a16e17b9ad6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7fec1f5ba8ef43ba9a04a16e17b9ad6d", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesNegativeTest-1612100881 Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 7fec1f5ba8ef43ba9a04a16e17b9ad6d Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesNegativeTest-1612100881 Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesNegativeTest-1612100881-project Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 72941424337943908351c9d6c812ce97 Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesNegativeTest-1612100881-project Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 could not be found. Aug 09 11:28:10.404672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '04eadd8a-1b15-4226-8c0f-98d8a7687f52'} Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 could not be found. Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:28:10.405486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 could not be found. Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 could not be found. Aug 09 11:28:10.406620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:28:10.408445 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] Returning 404 to user: Instance 04eadd8a-1b15-4226-8c0f-98d8a7687f52 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:28:10.408592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:10.409681 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-55ab02b0-fa26-4603-9cbe-c16746a1985d tempest-VolumesNegativeTest-1612100881 tempest-VolumesNegativeTest-1612100881-project] 10.222.0.59 "GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52" status: 404 len: 111 microversion: 2.1 time: 0.091840 Aug 09 11:28:10.409827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:10.410536 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 196/380] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:10 2022] GET /compute/v2.1/servers/04eadd8a-1b15-4226-8c0f-98d8a7687f52 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:28:10.517879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:10.518902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:10.531838 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:10.533708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:10.535588 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:10.538262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:10.540586 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:10.544683 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:10.801371 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:10.809323 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7c5d0fe7-971a-440d-b78c-33e9d16d0641 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.450787 Aug 09 11:28:10.819021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 185/381] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:10 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:10.866652 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:10.877529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-673c10ec-f7e6-4766-abeb-9c999662949d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.363945 Aug 09 11:28:10.883776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 197/382] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:10 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:11.836893 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:11.838567 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:11.849090 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:11.849624 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:11.850088 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:11.851224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:11.851675 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:11.852093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:11.906412 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:11.907084 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:11.915285 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:11.915818 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:11.916486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:11.917336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:11.918004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:11.918577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:12.043666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:12.054666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6bc71df2-0203-4a3e-95fb-f3de71ed681e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.222941 Aug 09 11:28:12.056346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 186/383] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:11 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:12.100541 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:12.110012 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-78971548-a203-4aaa-9b21-08110e80a1df tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.209753 Aug 09 11:28:12.110588 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 198/384] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:11 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:13.080004 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:13.081707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:13.089689 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:13.090131 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:13.090561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:13.091328 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:13.091784 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:13.092209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:13.136809 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:13.137814 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:13.148117 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:13.149265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:13.150210 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:13.151720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:13.152537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:13.153669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:13.425809 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:13.445588 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6d5077af-9391-42d8-99d0-c40f926ebfd1 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.370609 Aug 09 11:28:13.448499 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 187/385] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:13 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:13.536791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:13.545509 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-daa24100-acf6-45dc-82a9-2f6783189a4d tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.416268 Aug 09 11:28:13.547944 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 199/386] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:13 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:14.469284 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:14.470590 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:14.479294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:14.479962 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:14.480583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:14.482050 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:14.483143 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:14.483751 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:14.571981 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:14.572913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:14.581391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:14.582347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:14.583180 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:14.584413 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:14.585187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:14.585858 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:14.822213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:14.830730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7e7ac425-c18b-49b5-b2d4-c79f550c6675 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.365761 Aug 09 11:28:14.834594 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 188/387] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:14 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:14.854339 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:14.881704 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-44733477-d695-449d-a2ba-bc4a44230116 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.316510 Aug 09 11:28:14.882324 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 200/388] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:14 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:15.845287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-fb278076-8972-4a4d-9655-b4bb88565496 req-e6777e64-7e74-43b0-ab4d-31b383762b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "356432f3-2475-4a32-9017-d095c516d414", "name": "network-vif-plugged", "status": "completed", "tag": "20c6af6b-bf87-427e-9768-c4e17bb50edc"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:15.856063 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:15.856677 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:15.868265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:15.870335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:15.870863 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:15.871296 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:15.875077 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:15.875910 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:15.876572 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:15.884843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-fb278076-8972-4a4d-9655-b4bb88565496 req-e6777e64-7e74-43b0-ab4d-31b383762b2b service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:15.885670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-fb278076-8972-4a4d-9655-b4bb88565496 req-e6777e64-7e74-43b0-ab4d-31b383762b2b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:15.886265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-fb278076-8972-4a4d-9655-b4bb88565496 req-e6777e64-7e74-43b0-ab4d-31b383762b2b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:15.918802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-fb278076-8972-4a4d-9655-b4bb88565496 req-e6777e64-7e74-43b0-ab4d-31b383762b2b service nova] Creating event network-vif-plugged:20c6af6b-bf87-427e-9768-c4e17bb50edc for instance 356432f3-2475-4a32-9017-d095c516d414 on hv-cinder-84989 Aug 09 11:28:15.935852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-fb278076-8972-4a4d-9655-b4bb88565496 req-e6777e64-7e74-43b0-ab4d-31b383762b2b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094384 Aug 09 11:28:15.937238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 189/389] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:15.952677 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:15.953508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:15.962976 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:15.963902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:15.964564 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:15.965503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:15.966193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:15.966858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:16.152428 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:16.165764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f5a868d9-1269-47c1-b220-522be69369f5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.313647 Aug 09 11:28:16.166940 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 201/390] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:15 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:16.246294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:16.259831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e298d5cb-5e66-4acb-b058-ff9b320557ee tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.320451 Aug 09 11:28:16.262059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 190/391] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:15 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:17.196174 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:17.196789 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:17.204385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:17.204886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:17.205526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:17.206416 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:17.206897 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:17.207504 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:17.287222 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:17.288048 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:17.297830 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:17.298711 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:17.300105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:17.301117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:17.301802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:17.302437 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:17.398537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:17.419224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-216d87d0-83b0-4202-8eaf-8bafb84b9e91 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.227003 Aug 09 11:28:17.420307 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 202/392] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:17 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:17.584375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:17.598158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-128040ba-0ac6-43c0-bb07-a0d574ec23c3 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.315873 Aug 09 11:28:17.598765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 191/393] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:17 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:18.445771 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:18.447095 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:18.456078 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:18.456863 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:18.457476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:18.458221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:18.458714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:18.459256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:18.621523 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:18.622090 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:18.634631 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:18.635193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:18.635629 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:18.636370 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:18.636829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:18.637254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:19.087362 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:19.098503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e6b777d4-8a24-417e-83e7-89002d61626a tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1313 microversion: 2.1 time: 0.481482 Aug 09 11:28:19.100278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 192/394] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:18 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:19.107578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:19.117506 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a1aaa24c-bf52-475c-a485-457a70dbda50 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.680005 Aug 09 11:28:19.118231 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 203/395] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:18 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:20.124180 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:20.125688 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:20.135224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:20.136184 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:20.136789 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:20.137695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:20.138304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:20.139211 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:20.141318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:20.143206 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:20.162357 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:20.163755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:20.165837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:20.166692 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:20.167230 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:20.168404 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:20.493679 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:20.507824 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8d7da3ce-7d8e-4f72-bdac-e9636c5b9964 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1497 microversion: 2.1 time: 0.389903 Aug 09 11:28:20.508696 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 193/396] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:20 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1497 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:20.572237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:20.589580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7bbd5eea-1c81-40b6-80f0-1fbfeda8b704 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.454388 Aug 09 11:28:20.591945 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 204/397] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:20 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:21.632491 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:21.633987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:21.643504 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:21.644147 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:21.644833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:21.645798 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:21.648398 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:21.649072 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:21.859572 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:21.874433 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-81e28451-6846-4cae-a1bf-1028957f0a68 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.247695 Aug 09 11:28:21.875069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 194/398] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:21 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:21.915569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:21.916844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:21.924824 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:21.925327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:21.928602 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:21.929857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:21.930581 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:21.932149 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:21.979302 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:28:21.984038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1857762969", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "networks": [{"uuid": "7c1f5109-d487-4765-86e5-fb0ecb5ba983"}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:22.106736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c87068d8-e68d-4b95-baa5-f12a568f9ac5 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "DELETE /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 204 len: 0 microversion: 2.1 time: 0.197914 Aug 09 11:28:22.107394 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 205/399] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:28:21 2022] DELETE /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:28:22.115764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] validate_networks() for [('7c1f5109-d487-4765-86e5-fb0ecb5ba983', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:28:22.119322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:22.120137 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:22.133006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:22.135343 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:22.140191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:22.154844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:22.158294 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:22.159907 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:22.578966 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:22.593961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a1978ff8-40e9-431d-8be7-914c1c670b29 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1503 microversion: 2.1 time: 0.479285 Aug 09 11:28:22.611721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 206/400] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:22 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1503 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:22.909163 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:22.910046 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:22.921175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:22.922317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:22.922995 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:22.923928 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:22.925264 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:22.926860 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:23.045687 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:28:23.046214 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:28:23.046556 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:28:23.047026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:28:23.048548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:28:23.062493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:23.063547 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:23.064873 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:23.065995 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:23.067046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:23.067745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:23.096513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Getting quotas for project ef17bd64c2e648c5b0e4543e635e3d7a. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:28:23.112092 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Getting quotas for user 50e392889ece4517a139dfde15fcb208 and project ef17bd64c2e648c5b0e4543e635e3d7a. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:28:23.130549 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:28:23.134176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:28:23.201830 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:23.216580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-78bb4a90-aa4b-44ed-9006-213ab27b28c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.311064 Aug 09 11:28:23.218205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 207/401] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:22 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:23.229011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-be64390c-2972-42ba-b05b-1dcd148b586f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.259614 Aug 09 11:28:23.230271 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 195/402] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:28:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:28:23.244507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7aef74fb-9140-4555-9b0d-6024311bf748 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:23.245566 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7aef74fb-9140-4555-9b0d-6024311bf748 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:23.355481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7aef74fb-9140-4555-9b0d-6024311bf748 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:23.363663 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7aef74fb-9140-4555-9b0d-6024311bf748 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1219 microversion: 2.1 time: 0.124635 Aug 09 11:28:23.364306 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 208/403] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:23 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:23.624456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:23.626546 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:23.653176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:23.654142 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:23.655487 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:23.657081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:23.658151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:23.659185 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:23.948042 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:23.963964 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3cffb5c6-377e-4bd5-8002-6c1d5ccf9d52 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1503 microversion: 2.1 time: 0.345117 Aug 09 11:28:23.967376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 196/404] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:23 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:24.237837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:24.238715 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:24.240810 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:24.254678 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:24.255418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:24.256380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:24.268011 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:24.268786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:24.269467 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:24.392169 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:24.397368 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:24.442061 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:24.443046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:24.443506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:24.444287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:24.444755 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:24.445193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:24.615970 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:24.625499 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-939e0fc2-745f-4f1f-b5dc-1a40c94dbc1b tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1215 microversion: 2.1 time: 0.243635 Aug 09 11:28:24.626858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 197/405] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:24 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:24.640520 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:24.645320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ae98705c-aa07-4d5c-bd71-bd454a802f69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.411381 Aug 09 11:28:24.646149 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 209/406] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:24 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:24.991395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:24.993190 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:25.002947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:25.004654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:25.005323 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:25.006302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:25.007645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:25.008351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:25.015568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:25.223625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:25.235386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-540c8e14-f17f-4867-b16e-12b294a1590e tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1503 microversion: 2.1 time: 0.249069 Aug 09 11:28:25.236347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 198/407] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:24 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:25.384204 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-32bbb02c-7d5b-4513-a9f7-eaf422e60033 req-39148163-d7a0-47e4-bed5-cb598ef7b3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "356432f3-2475-4a32-9017-d095c516d414", "name": "network-vif-deleted", "tag": "20c6af6b-bf87-427e-9768-c4e17bb50edc"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:25.399347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-32bbb02c-7d5b-4513-a9f7-eaf422e60033 req-39148163-d7a0-47e4-bed5-cb598ef7b3ca service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:25.402389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-32bbb02c-7d5b-4513-a9f7-eaf422e60033 req-39148163-d7a0-47e4-bed5-cb598ef7b3ca service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:25.403748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-32bbb02c-7d5b-4513-a9f7-eaf422e60033 req-39148163-d7a0-47e4-bed5-cb598ef7b3ca service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:25.421142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-32bbb02c-7d5b-4513-a9f7-eaf422e60033 req-39148163-d7a0-47e4-bed5-cb598ef7b3ca service nova] Creating event network-vif-deleted:20c6af6b-bf87-427e-9768-c4e17bb50edc for instance 356432f3-2475-4a32-9017-d095c516d414 on hv-cinder-84989 Aug 09 11:28:25.430537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-32bbb02c-7d5b-4513-a9f7-eaf422e60033 req-39148163-d7a0-47e4-bed5-cb598ef7b3ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050487 Aug 09 11:28:25.431873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 210/408] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:25.648717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:25.649768 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:25.659364 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:25.660331 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:25.661434 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:25.662988 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:25.664161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:25.665337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:25.684592 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:25.685991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:25.711184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:25.711184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:25.711184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:25.711184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:25.712030 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:25.712030 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:25.795607 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:25.806762 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-898de5f5-3de9-4768-ba10-3f33c54401bd tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1271 microversion: 2.1 time: 0.162908 Aug 09 11:28:25.823055 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 199/409] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:25 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:25.959410 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:25.964185 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:25.971357 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-16a008c8-1561-4f26-acae-d206de0e8c03 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.307675 Aug 09 11:28:25.971956 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 211/410] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:25 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:26.204713 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b2e38a63-9f4f-4597-bd91-e70dfabef9d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Action: 'create', calling method: .version_select at 0x7fece2670af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-765636033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGhbELusQ3nhDM/ViWWLdatbMS9RixwhUTBF5k6/ygE7Q5kja046v0uSFsTBIQNLcheK1Ee4GZK0uzHxdzaTglMedNhJfaNViDZJN/wltViuPP0ijeswoCESeUFtIulGA=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:26.223980 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-b2e38a63-9f4f-4597-bd91-e70dfabef9d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Getting quotas for project d5b4feb5fe1746a2b54b81e61558d4c0. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:28:26.228707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-b2e38a63-9f4f-4597-bd91-e70dfabef9d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Getting quotas for user b477645d5d814644aa77e11066f0489d and project d5b4feb5fe1746a2b54b81e61558d4c0. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:28:26.258025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:26.258369 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b2e38a63-9f4f-4597-bd91-e70dfabef9d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.308207 Aug 09 11:28:26.258626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:26.268805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:26.269622 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:26.270272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:26.271571 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:26.274973 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 200/411] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:28:25 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:28:26.278986 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:26.280409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:26.392122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fa4a9037534826bb11e503c20b4dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc240016ba8447da04bbf7804e3d801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:26.410881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-525a60b7-faf9-43be-ae21-75b356ab48e4 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 200 len: 1298 microversion: 2.1 time: 0.156886 Aug 09 11:28:26.424464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 212/412] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:26 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 1298 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:26.834658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:26.835709 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:26.846537 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:26.847021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:26.849732 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:26.850504 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:26.851015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:26.854339 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:26.994292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:26.994992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:27.007416 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:27.010347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:27.011899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:27.013588 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:27.015856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:27.019557 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:27.040422 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:27.051707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ffb1365e-42f8-47fc-b826-0400eceb13df tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1277 microversion: 2.1 time: 0.222165 Aug 09 11:28:27.069438 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 201/413] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:26 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:27.311386 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:27.324328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c7ff0fa9-1b13-408b-817e-bbbf90ae0bc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.334564 Aug 09 11:28:27.325104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 213/414] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:26 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:27.433961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:27.434739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] [instance: 356432f3-2475-4a32-9017-d095c516d414] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:27.448523 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:27.449027 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:27.449467 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:27.450196 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:27.450668 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:27.451123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:27.488948 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] HTTP exception thrown: Instance 356432f3-2475-4a32-9017-d095c516d414 could not be found. Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Request method failure captured: Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 HTTP/1.1 Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kSMlz0A_5rVEJqnqWE9QuHo67cvXm3wnRQdePaHdUqN9jkfYuzOGxlVJ2C2EsDMaTb3sVYAAgPALklMAzF_uv9qnRf_tSVuVDk0VSvREcerTPyQsT7ZUbiDOJiBclXYPEAjbAaRFwJMIKCpArHjvkROgj1WcPlKNnNhKM7-X1Bl2Xo Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: bfc240016ba8447da04bbf7804e3d801 Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesActionsTest-1151995716 Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:28:27.490966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bfc240016ba8447da04bbf7804e3d801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bfc240016ba8447da04bbf7804e3d801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bfc240016ba8447da04bbf7804e3d801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bfc240016ba8447da04bbf7804e3d801", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesActionsTest-1151995716 Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: bfc240016ba8447da04bbf7804e3d801 Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesActionsTest-1151995716 Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesActionsTest-1151995716-project Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 20fa4a9037534826bb11e503c20b4dcb Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesActionsTest-1151995716-project Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 356432f3-2475-4a32-9017-d095c516d414 could not be found. Aug 09 11:28:27.492542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '356432f3-2475-4a32-9017-d095c516d414'} Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 356432f3-2475-4a32-9017-d095c516d414 could not be found. Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:28:27.493395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 356432f3-2475-4a32-9017-d095c516d414 could not be found. Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 356432f3-2475-4a32-9017-d095c516d414 could not be found. Aug 09 11:28:27.494673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:27.501595 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] Returning 404 to user: Instance 356432f3-2475-4a32-9017-d095c516d414 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:28:27.501595 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-16c18b5c-51cb-4796-b1cf-400443d14b82 tempest-VolumesActionsTest-1151995716 tempest-VolumesActionsTest-1151995716-project] 10.222.0.59 "GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414" status: 404 len: 111 microversion: 2.1 time: 0.062613 Aug 09 11:28:27.501595 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 202/415] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:27 2022] GET /compute/v2.1/servers/356432f3-2475-4a32-9017-d095c516d414 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:28:28.077798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:28.078711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:28.090384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:28.092088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:28.093951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:28.095029 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:28.096111 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:28.096755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:28.307750 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:28.317344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8ba01318-d0c7-43ec-a28f-64d3bb1a2081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.244201 Aug 09 11:28:28.318417 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 214/416] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:28 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:28.349880 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:28.351888 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:28.369482 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:28.383685 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:28.384514 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:28.387490 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:28.388193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:28.391479 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:28.601309 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:28.611852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-13a0583f-08a0-45fd-b1e8-e1542e13eaca tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.269597 Aug 09 11:28:28.612464 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 203/417] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:28 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:28.862446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e4d7e13a-7c11-4265-aabf-503dc916f071 req-36cc472d-fc08-4715-95d1-05b882c884c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9983eb2-0da6-452f-9608-55b4c87fd1da", "tag": "e34c8cd6-1bc8-43a8-ad42-b51f869a4cce"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:28.894775 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e4d7e13a-7c11-4265-aabf-503dc916f071 req-36cc472d-fc08-4715-95d1-05b882c884c2 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:28.895299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e4d7e13a-7c11-4265-aabf-503dc916f071 req-36cc472d-fc08-4715-95d1-05b882c884c2 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:28.895729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e4d7e13a-7c11-4265-aabf-503dc916f071 req-36cc472d-fc08-4715-95d1-05b882c884c2 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:28.933340 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e4d7e13a-7c11-4265-aabf-503dc916f071 req-36cc472d-fc08-4715-95d1-05b882c884c2 service nova] Creating event network-changed:e34c8cd6-1bc8-43a8-ad42-b51f869a4cce for instance b9983eb2-0da6-452f-9608-55b4c87fd1da on hv-cinder-84989 Aug 09 11:28:28.948884 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e4d7e13a-7c11-4265-aabf-503dc916f071 req-36cc472d-fc08-4715-95d1-05b882c884c2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089948 Aug 09 11:28:28.950045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 215/418] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:29.338121 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:29.338770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:29.346213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.346697 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.347168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.347847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.348315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.348738 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.490595 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:29.498423 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9381a368-f1e3-4081-a34e-6434dec02fb7 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.164271 Aug 09 11:28:29.499082 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 204/419] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:29 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:29.635413 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:29.636284 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:29.643606 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.644095 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.644511 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.645240 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.645724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.646149 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.811272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:29.823932 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f4c3ef4a-fc61-4a3c-bfdb-778e824be166 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1501 microversion: 2.1 time: 0.193802 Aug 09 11:28:29.824990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 216/420] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:29 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:29.846716 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9104370-3ff1-44fd-ab54-8c0c9bcc6ee1"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:29.850913 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:29.864300 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.865008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.865601 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.866499 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.867070 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.867642 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.892828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] HTTP exception thrown: Cannot 'attach_volume' instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 while it is in vm_state rescued Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Request method failure captured: Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: POST /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79/os-volume_attachments HTTP/1.1 Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 74 Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRG0rpW3sj4nheZdhbCxPm1Z5jfdUcOxP527qQ7_jhokZykFQKs4TqP5xopsG9oPMsNJkr1PNRrC0MRk4UMMaYA88FH_DuQHQWbKZ_AZE6sayLLRgjaZLDJoymwC7JncPc5njCMgeqjV2Sb9VT0FTc_qt5jZ6gsr1fDQYvwfbnyN-o Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:28:29.894582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b0a6fd5299a7475bad7836d22b23967d", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 8f9dc600fea34effa2afa8aee54aab7e Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {"volumeAttachment": {"volumeId": "b9104370-3ff1-44fd-ab54-8c0c9bcc6ee1"}} Aug 09 11:28:29.896234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Cannot 'attach_volume' instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 while it is in vm_state rescued Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'server_id': 'f727a3f9-56c8-4305-bcd5-68f8d6d31f79', 'body': {'volumeAttachment': {'volumeId': 'b9104370-3ff1-44fd-ab54-8c0c9bcc6ee1'}}} Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:28:29.897052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 while it is in vm_state rescued Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:28:29.898249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:28:29.899374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:28:29.899374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:28:29.899374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 while it is in vm_state rescued Aug 09 11:28:29.899374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:28:29.899374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Returning 409 to user: Cannot 'attach_volume' instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 while it is in vm_state rescued {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:28:29.899374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-56ae5325-23dd-44ca-a8a6-d565d477368a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053793 Aug 09 11:28:29.899374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 205/421] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:28:29 2022] POST /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 11:28:29.907875 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-151d5450-f04b-46e4-9be2-446e2d3b405b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:29.908417 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-151d5450-f04b-46e4-9be2-446e2d3b405b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:29.914875 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-151d5450-f04b-46e4-9be2-446e2d3b405b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.915363 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-151d5450-f04b-46e4-9be2-446e2d3b405b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.915846 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-151d5450-f04b-46e4-9be2-446e2d3b405b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.916541 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-151d5450-f04b-46e4-9be2-446e2d3b405b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:29.916986 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-151d5450-f04b-46e4-9be2-446e2d3b405b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:29.917628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-151d5450-f04b-46e4-9be2-446e2d3b405b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:29.999547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-151d5450-f04b-46e4-9be2-446e2d3b405b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79/action" status: 202 len: 0 microversion: 2.1 time: 0.094847 Aug 09 11:28:30.000565 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 217/422] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:28:29 2022] POST /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:28:30.010218 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:30.011898 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:30.019344 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:30.020385 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:30.020967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:30.021656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:30.022161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:30.022850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:30.170425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:30.178963 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7747f075-2c64-4ff5-8143-729809ecba62 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.173820 Aug 09 11:28:30.179589 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 206/423] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:30 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:30.519909 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:30.520609 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:30.526930 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:30.527422 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:30.527857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:30.528659 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:30.529025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:30.529444 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:30.668145 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:30.677724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-002f389a-e38c-4375-888e-0c20a1fc5717 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.162241 Aug 09 11:28:30.678478 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 218/424] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:30 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:31.201644 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:31.202257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:31.208681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:31.209191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:31.209613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:31.210330 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:31.210783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:31.211241 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:31.351267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:31.359534 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0e9a396c-2065-4400-876b-c52408a75034 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.162151 Aug 09 11:28:31.360425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 207/425] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:31 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:31.698771 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:31.699473 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:31.705903 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:31.706391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:31.706850 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:31.707522 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:31.707976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:31.708400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:31.858775 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:31.867135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4e4ff004-88f1-4493-8f09-201f268d60f5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.172938 Aug 09 11:28:31.867776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 219/426] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:31 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:32.381418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:32.381990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:32.392227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:32.392796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:32.393435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:32.394463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:32.395207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:32.395821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:32.542527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:32.550991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e73e4c27-8938-4b64-8bd9-278cc26f4f13 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.173882 Aug 09 11:28:32.551574 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 208/427] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:32 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:32.889818 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:32.890366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:32.900797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:32.900797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:32.900797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:32.900797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:32.901378 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:32.901378 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:33.088425 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:33.100489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-df1fef67-9b48-456b-9406-288dd548ff35 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.215660 Aug 09 11:28:33.101351 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 220/428] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:32 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:33.574650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:33.575327 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:33.577225 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:33.583401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:33.583977 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:33.584419 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:33.585116 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:33.586315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:33.586557 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:33.727965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:33.736047 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bf05fd1c-685d-4dab-bf10-0f15bc6efebc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.166353 Aug 09 11:28:33.736645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 209/429] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:33 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:34.134390 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:34.135100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:34.138396 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:34.142374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:34.142895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:34.143328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:34.144030 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:34.144472 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:34.144893 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:34.314263 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:34.329947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e3bf11dd-6e1e-4e76-baeb-daf9d91f5e15 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.199409 Aug 09 11:28:34.330630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 221/430] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:34 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:34.759300 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:34.759909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:34.766776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:34.767298 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:34.767905 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:34.768422 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:34.768878 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:34.769357 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:34.950401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:34.959690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2681a542-5a31-4c88-9b80-c5b8d173444e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.204103 Aug 09 11:28:34.960289 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 210/431] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:34 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:35.355994 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:35.359052 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:35.380203 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:35.381818 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:35.382936 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:35.388109 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:35.388830 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:35.389875 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:35.633113 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:35.649070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e126bfb1-96ad-4f77-97bf-3da800014e0a tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.300036 Aug 09 11:28:35.650097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 222/432] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:35 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:35.999857 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:36.002191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:36.010998 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:36.012205 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:36.014287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:36.015418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:36.016392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:36.017349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:36.236658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=10 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:36.246771 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:36.267070 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9ea88bab-96e9-4e9e-b879-555a016cc56d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.279773 Aug 09 11:28:36.268939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 211/433] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:35 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:36.681667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:36.682488 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:36.706101 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:36.707003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:36.708136 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:36.709727 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:36.710791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:36.711914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:37.033509 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:37.051237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9e892056-2402-4e30-b24f-5726f7da22d3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.376048 Aug 09 11:28:37.054312 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 223/434] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:36 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:37.306937 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:37.307937 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:37.316586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:37.317436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:37.317897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:37.318661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:37.319179 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:37.319618 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:37.578336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:37.589721 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2a66c952-4abe-4a35-abf3-4aa112f74743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.287986 Aug 09 11:28:37.590436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 212/435] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:37 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:38.078609 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:38.079876 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:38.089741 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:38.091195 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:38.092148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:38.093269 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:38.094431 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:38.095901 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:38.280948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:38.290038 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2eb7eb30-2541-4bb9-92c2-d94d25537b58 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.218766 Aug 09 11:28:38.290923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 224/436] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:38 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:38.639974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:38.641193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:38.654879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:38.654879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:38.654879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:38.654879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:38.655444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:38.655444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:38.840863 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:38.850989 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0083cafc-13ad-42d5-bb1a-80b125629fb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.217913 Aug 09 11:28:38.851876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 213/437] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:38 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:39.312557 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:39.313171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:39.320047 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:39.320868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:39.321530 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:39.322408 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:39.323175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:39.323876 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:39.525255 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:39.534697 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ebbb3c63-3f1d-4782-8223-795c226c9310 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.226672 Aug 09 11:28:39.535347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 225/438] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:39 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:39.874388 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:39.875245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:39.882439 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:39.883347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:39.884361 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:39.885474 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:39.886196 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:39.886713 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:40.076064 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:40.084735 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-742fc84c-e63b-40b7-8703-fb9c449e782f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.214812 Aug 09 11:28:40.085311 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 214/439] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:39 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:40.573083 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:40.575506 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:40.588003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:40.589227 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:40.589965 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:40.591539 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:40.592951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:40.593635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:40.838286 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:40.851024 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6dcbbfed-146d-4a57-9630-8f98852158e5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.286226 Aug 09 11:28:40.852293 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 226/440] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:40 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:41.106830 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:41.107642 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:41.115869 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:41.117490 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:41.118157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:41.119397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:41.120394 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:41.120868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:41.295407 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:41.304982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-69b806b0-5b3b-43a1-9e12-22b5df235b17 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1509 microversion: 2.1 time: 0.202191 Aug 09 11:28:41.305812 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 215/441] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:41 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:41.470685 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-f1bb3823-c94c-4b90-93d7-fc0334d96844 req-5e4a7ca6-e609-46cf-9c2a-085cf95193e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9983eb2-0da6-452f-9608-55b4c87fd1da", "name": "network-vif-plugged", "status": "completed", "tag": "e34c8cd6-1bc8-43a8-ad42-b51f869a4cce"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:41.482183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f1bb3823-c94c-4b90-93d7-fc0334d96844 req-5e4a7ca6-e609-46cf-9c2a-085cf95193e3 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:41.483132 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f1bb3823-c94c-4b90-93d7-fc0334d96844 req-5e4a7ca6-e609-46cf-9c2a-085cf95193e3 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:41.483848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f1bb3823-c94c-4b90-93d7-fc0334d96844 req-5e4a7ca6-e609-46cf-9c2a-085cf95193e3 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:41.500602 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-f1bb3823-c94c-4b90-93d7-fc0334d96844 req-5e4a7ca6-e609-46cf-9c2a-085cf95193e3 service nova] Creating event network-vif-plugged:e34c8cd6-1bc8-43a8-ad42-b51f869a4cce for instance b9983eb2-0da6-452f-9608-55b4c87fd1da on hv-cinder-84989 Aug 09 11:28:41.508301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-f1bb3823-c94c-4b90-93d7-fc0334d96844 req-5e4a7ca6-e609-46cf-9c2a-085cf95193e3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042213 Aug 09 11:28:41.509366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 227/442] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:41.886857 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:41.886857 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:41.895103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:41.895664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:41.896315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:41.896904 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:41.897437 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:41.897900 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:42.054047 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:42.059205 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:42.065677 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-86dab068-47d0-4c00-9fed-da00daa6fbd4 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.188062 Aug 09 11:28:42.066495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 216/443] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:41 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:42.331033 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:42.332140 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:42.340052 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:42.344209 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:42.348821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:42.353263 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:42.353880 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:42.354330 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:42.627094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:42.631599 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:42.638688 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3c5ac01e-ae07-436f-812b-b44885799d7e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1515 microversion: 2.1 time: 0.312235 Aug 09 11:28:42.639322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 228/444] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:42 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:43.087981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:43.089540 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:43.104591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:43.105104 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:43.109976 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:43.116575 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:43.117325 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:43.118483 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:43.315467 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:43.325458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7f2cf593-bc1a-46bf-b4ae-b403b327c902 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1319 microversion: 2.1 time: 0.242151 Aug 09 11:28:43.326475 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 217/445] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:43 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:44.349789 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:44.350428 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:44.359210 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:44.360025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:44.360452 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:44.361364 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:44.361838 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:44.362531 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:44.535069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:44.544529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-07fb86ab-df3b-4053-aa62-49bbec6dc10e tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1508 microversion: 2.1 time: 0.199177 Aug 09 11:28:44.545489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 229/446] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:44 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:45.368265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cdce0536-05d0-4f9a-937d-0fc62e0f0e8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'create', calling method: .version_select at 0x7fece2670430>, body: {"keypair": {"name": "tempest-keypair-760856355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm0/jvKXpEnjiFTsQIm2jSmwparxn5RF2SLc5Gv54YGdmH6R9cTl/iwBTGRR67O9cv4fYxOnvTTFRRQIHjMLaeI8/FibXBQPIid8izZYB6D9FcR1T7YpBJoI5WpZNu96g=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:45.396393 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-cdce0536-05d0-4f9a-937d-0fc62e0f0e8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Getting quotas for project b0a6fd5299a7475bad7836d22b23967d. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:28:45.405654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-cdce0536-05d0-4f9a-937d-0fc62e0f0e8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Getting quotas for user 8f9dc600fea34effa2afa8aee54aab7e and project b0a6fd5299a7475bad7836d22b23967d. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:28:45.442764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cdce0536-05d0-4f9a-937d-0fc62e0f0e8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079426 Aug 09 11:28:45.443835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 218/447] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:28:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:28:47.259338 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1551606467", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cada0da3-73dc-4829-967e-cf7277f4eed4"}], "security_groups": [{"name": "tempest-securitygroup--19151207"}], "key_name": "tempest-keypair-760856355", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:49.470502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] validate_networks() for [('cada0da3-73dc-4829-967e-cf7277f4eed4', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:28:49.981836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:28:49.982259 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:28:49.982727 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:28:49.983164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:28:49.983654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:28:50.007660 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:50.008389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:50.009040 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:50.009976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:50.010673 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:50.011143 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:50.033728 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Getting quotas for project b0a6fd5299a7475bad7836d22b23967d. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:28:50.038868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Getting quotas for user 8f9dc600fea34effa2afa8aee54aab7e and project b0a6fd5299a7475bad7836d22b23967d. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:28:50.051364 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:28:50.054086 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:28:50.123548 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7d66dfc0-4742-4d11-b71e-af2263ddd357 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.868498 Aug 09 11:28:50.124205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 230/448] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:28:47 2022] POST /compute/v2.1/servers => generated 407 bytes in 2870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:28:50.137851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fc18b6ef-c330-4038-859e-bc0370aed5c8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:50.138489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fc18b6ef-c330-4038-859e-bc0370aed5c8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:50.141135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:50.206019 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fc18b6ef-c330-4038-859e-bc0370aed5c8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:50.216158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fc18b6ef-c330-4038-859e-bc0370aed5c8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1245 microversion: 2.1 time: 0.084340 Aug 09 11:28:50.216727 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 219/449] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:50 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:51.239817 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:51.240383 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:51.246851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:51.247326 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:51.247766 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:51.248487 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:51.248981 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:51.249447 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:51.321476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:51.335264 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-83cebedd-e223-44dd-938e-a7af0befe53f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1297 microversion: 2.1 time: 0.100760 Aug 09 11:28:51.336377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 231/450] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:51 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:52.357289 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:52.358377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:52.370297 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:52.370803 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:52.371260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:52.377721 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:52.379396 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:52.382471 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:52.486411 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:52.498614 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a77158b6-c060-4ad0-9ef7-c5b4c4bea14e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1303 microversion: 2.1 time: 0.145541 Aug 09 11:28:52.512261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 220/451] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:52 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:53.520964 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:53.522109 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:53.529039 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:53.529938 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:53.530611 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:53.531623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:53.532324 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:53.532998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:53.651732 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-7b007b08-0274-41c7-adac-9d3c6e5e04e3 req-fbb3d3cd-59fc-4c42-8451-ab252e1c2fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c922f63-17a0-4421-bd4d-7a4430540a29", "tag": "d007e409-d8a8-4797-bfb3-ed337e9631c6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:28:53.670767 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7b007b08-0274-41c7-adac-9d3c6e5e04e3 req-fbb3d3cd-59fc-4c42-8451-ab252e1c2fa7 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:53.671690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7b007b08-0274-41c7-adac-9d3c6e5e04e3 req-fbb3d3cd-59fc-4c42-8451-ab252e1c2fa7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:53.672425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7b007b08-0274-41c7-adac-9d3c6e5e04e3 req-fbb3d3cd-59fc-4c42-8451-ab252e1c2fa7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:53.699746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-7b007b08-0274-41c7-adac-9d3c6e5e04e3 req-fbb3d3cd-59fc-4c42-8451-ab252e1c2fa7 service nova] Creating event network-changed:d007e409-d8a8-4797-bfb3-ed337e9631c6 for instance 8c922f63-17a0-4421-bd4d-7a4430540a29 on hv-cinder-84989 Aug 09 11:28:53.721395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-7b007b08-0274-41c7-adac-9d3c6e5e04e3 req-fbb3d3cd-59fc-4c42-8451-ab252e1c2fa7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074566 Aug 09 11:28:53.724493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 221/452] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:28:53.784348 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:53.797813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-10c441d4-276f-4a33-bf6a-4a551261e8de tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.280939 Aug 09 11:28:53.799209 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 232/453] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:53 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:54.821695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:54.822470 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:54.836420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:54.836909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:54.837811 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:54.838074 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:54.838681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:54.840570 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:55.018278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:55.051503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6dfca479-ab33-410d-aeba-0196e9796a2c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.234344 Aug 09 11:28:55.052718 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 222/454] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:54 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:56.150532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:56.152238 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:56.154661 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:56.165384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:56.166328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:56.167131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:56.168085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:56.168729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:56.169183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:56.358392 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:56.368264 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b3f7ba29-5a4c-4afc-bd39-0f14bd601913 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.221970 Aug 09 11:28:56.368853 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 233/455] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:56 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:57.390647 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:57.391282 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:57.398391 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:57.398872 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:57.399334 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:57.400024 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:57.400481 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:57.400954 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:57.549730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:57.557881 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-eb93bb72-322a-4faf-bfde-9a62f62f5d9d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.171138 Aug 09 11:28:57.558462 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 223/456] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:57 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:28:58.581528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:58.582183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:58.588669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:58.589154 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:58.589550 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:58.590290 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:58.590716 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:58.591144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:58.736219 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:28:58.746973 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-db8bfba8-223b-4b31-be69-cb3549a36e84 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.170652 Aug 09 11:28:58.747595 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 234/457] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:58 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:28:59.773016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:28:59.773619 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:28:59.781583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:59.782108 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:59.782569 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:28:59.783495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:28:59.783981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:28:59.784442 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:00.187261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:00.196984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1f7e7ea5-6396-4191-aaf7-f16b79f212ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.428179 Aug 09 11:29:00.197578 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 224/458] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:28:59 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:01.221837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:01.222461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:01.225918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:01.226988 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:01.231799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:01.232318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:01.232746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:01.233515 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:01.233932 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:01.234504 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:01.390279 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:01.407093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-be83d8ed-7a79-4093-8ef8-7e7dfb61dff2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.186107 Aug 09 11:29:01.407093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 235/459] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:01 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:02.428532 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:02.429152 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:02.431423 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:02.436885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:02.437379 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:02.437814 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:02.438522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:02.439011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:02.439446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:02.580745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:02.592502 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-04d790af-f77d-4ae9-bae2-23ccbe39a2e9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.168367 Aug 09 11:29:02.593197 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 225/460] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:02 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:03.618080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:03.618682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:03.625117 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:03.625597 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:03.626021 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:03.626710 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:03.627205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:03.627622 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:03.780995 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:03.791218 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7fc7c58e-b737-4c57-bd4f-ed9e941abb3b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.176783 Aug 09 11:29:03.791806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 236/461] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:03 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:04.815868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:04.816467 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:04.823791 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:04.824284 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:04.824716 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:04.825399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:04.825902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:04.826319 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:04.967682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:04.975831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0a4e9552-bed6-4d10-b7a1-d430dd8f5903 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.164022 Aug 09 11:29:04.976417 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 226/462] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:04 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:05.999975 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:06.000608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:06.007252 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:06.007747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:06.008219 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:06.008945 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:06.009407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:06.009838 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:06.150757 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:06.162361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fda9e551-c69d-44b5-9a10-7221d825e475 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.168878 Aug 09 11:29:06.163184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 237/463] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:05 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:07.185664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:07.186235 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:07.193350 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:07.193837 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:07.194271 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:07.195010 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:07.195468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:07.195897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:07.336649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:07.348153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-32a1a690-6517-4653-9434-b50a5d4d349c tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.166388 Aug 09 11:29:07.348773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 227/464] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:07 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:08.273405 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-58846e14-b7a3-4162-8c2b-ef03d91e942d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:08.274045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-58846e14-b7a3-4162-8c2b-ef03d91e942d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:08.280416 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58846e14-b7a3-4162-8c2b-ef03d91e942d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:08.280913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58846e14-b7a3-4162-8c2b-ef03d91e942d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:08.281344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58846e14-b7a3-4162-8c2b-ef03d91e942d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:08.282041 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58846e14-b7a3-4162-8c2b-ef03d91e942d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:08.282532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58846e14-b7a3-4162-8c2b-ef03d91e942d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:08.282996 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58846e14-b7a3-4162-8c2b-ef03d91e942d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:08.307090 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-58846e14-b7a3-4162-8c2b-ef03d91e942d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/ips" status: 200 len: 148 microversion: 2.1 time: 0.037647 Aug 09 11:29:08.307666 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 238/465] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:29:08 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:08.369808 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:08.370516 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:08.376971 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:08.377463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:08.377893 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:08.378604 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:08.379092 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:08.379503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:08.521382 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:08.529788 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c738fcd0-fe77-4ce9-9c9e-5fc82f1123ea tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.164095 Aug 09 11:29:08.530399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 228/466] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:08 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:09.551652 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:09.552282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:09.558793 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:09.559316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:09.559748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:09.560441 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:09.561022 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:09.561312 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:09.704776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:09.712739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1ee2dca1-99b4-4589-9412-1bacf16ab60d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.165034 Aug 09 11:29:09.713327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 239/467] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:09 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:10.733770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:10.734916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:10.742993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:10.743589 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:10.744127 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:10.744981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:10.745637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:10.746341 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:10.891158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:10.899470 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-388da4cd-d870-4f48-9273-1bffe2ae9df6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.169700 Aug 09 11:29:10.900070 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 229/468] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:10 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:11.311848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-91c351f4-c828-4791-8c0c-fd15c0a9a70d req-adb93bb8-f33e-4b2a-a50e-71fba63c0b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c922f63-17a0-4421-bd4d-7a4430540a29", "name": "network-vif-plugged", "status": "completed", "tag": "d007e409-d8a8-4797-bfb3-ed337e9631c6"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:11.323194 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-91c351f4-c828-4791-8c0c-fd15c0a9a70d req-adb93bb8-f33e-4b2a-a50e-71fba63c0b03 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:11.323675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-91c351f4-c828-4791-8c0c-fd15c0a9a70d req-adb93bb8-f33e-4b2a-a50e-71fba63c0b03 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:11.324094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-91c351f4-c828-4791-8c0c-fd15c0a9a70d req-adb93bb8-f33e-4b2a-a50e-71fba63c0b03 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:11.338257 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-91c351f4-c828-4791-8c0c-fd15c0a9a70d req-adb93bb8-f33e-4b2a-a50e-71fba63c0b03 service nova] Creating event network-vif-plugged:d007e409-d8a8-4797-bfb3-ed337e9631c6 for instance 8c922f63-17a0-4421-bd4d-7a4430540a29 on hv-cinder-84989 Aug 09 11:29:11.344235 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-91c351f4-c828-4791-8c0c-fd15c0a9a70d req-adb93bb8-f33e-4b2a-a50e-71fba63c0b03 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036488 Aug 09 11:29:11.344831 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 240/469] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:29:11.922206 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:11.922838 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:11.929640 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:11.930125 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:11.930555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:11.931279 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:11.931728 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:11.932150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:12.073221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:12.075509 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=67 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:12.082006 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-142d5594-1e60-42c6-84cd-6b573e057f57 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.163700 Aug 09 11:29:12.082577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 230/470] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:11 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:12.884336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-05dbf453-e7a5-40e2-b9b9-d2d2d21f8974 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85dc2fd4-d356-4d21-a374-2bf78b5a1c7d"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:12.886796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-05dbf453-e7a5-40e2-b9b9-d2d2d21f8974 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:12.893294 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05dbf453-e7a5-40e2-b9b9-d2d2d21f8974 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:12.893776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05dbf453-e7a5-40e2-b9b9-d2d2d21f8974 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:12.894220 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05dbf453-e7a5-40e2-b9b9-d2d2d21f8974 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:12.894913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05dbf453-e7a5-40e2-b9b9-d2d2d21f8974 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:12.895368 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05dbf453-e7a5-40e2-b9b9-d2d2d21f8974 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:12.895797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05dbf453-e7a5-40e2-b9b9-d2d2d21f8974 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:13.103872 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:13.104466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:13.111131 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:13.111612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:13.112045 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:13.112732 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:13.113187 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:13.113613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:13.258903 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:13.266951 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cee6b3a4-0f77-47d3-be6b-9803c760bcb7 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.167198 Aug 09 11:29:13.267516 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 231/471] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:13 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:29:14.288345 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:14.289000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:14.295966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:14.296473 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:14.296914 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:14.297615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:14.298079 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:14.298500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:14.435572 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:14.443345 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f1faac70-670d-465f-af47-b55c2d82fd2a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.159051 Aug 09 11:29:14.443919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 232/472] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:14 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:15.464803 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:15.465446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:15.472948 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:15.473441 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:15.473857 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:15.474561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:15.475351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:15.475786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:15.611641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:15.624501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bd951542-1897-43fd-b6cd-177ae93720bc tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.162854 Aug 09 11:29:15.625465 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 233/473] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:15 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:16.650527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:16.651291 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:16.658420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:16.658995 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:16.659350 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:16.660043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:16.660495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:16.660911 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:16.812703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:16.820651 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-72f6af74-f9e7-464e-9f70-05a7202d191b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.174040 Aug 09 11:29:16.821229 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 234/474] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:16 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:17.844545 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:17.845427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:17.855314 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:17.855947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:17.856610 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:17.857735 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:17.858221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:17.858645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:18.009446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:18.017466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fae70861-4813-4f66-bba6-501574404c76 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.178970 Aug 09 11:29:18.018060 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 235/475] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:17 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:18.110920 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=69 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:18.250825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-05dbf453-e7a5-40e2-b9b9-d2d2d21f8974 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.370660 Aug 09 11:29:18.251450 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 241/476] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:29:12 2022] POST /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments => generated 194 bytes in 5372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:19.039828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:19.040407 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:19.048728 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:19.049276 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:19.049783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:19.050586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:19.051164 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:19.051665 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:19.198189 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:19.206161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2ce5fdd7-030c-4fe1-8719-be7b523a226b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.171110 Aug 09 11:29:19.206737 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 236/477] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:19 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:20.228146 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:20.228807 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:20.236451 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:20.236934 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:20.237384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:20.238356 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:20.238492 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:20.238931 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:20.377686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:20.385059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-88618a6b-0e45-458d-b51f-ce78d755556b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.161355 Aug 09 11:29:20.385623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 242/478] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:20 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:20.498947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1777661348", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-765636033", "security_groups": [{"name": "tempest-secgroup-smoke-1866648526"}], "networks": [{"uuid": "39fcc75c-2eea-44a0-80cb-75ef2730abb8"}], "block_device_mapping_v2": [{"uuid": "eb151910-5f20-42c2-afbb-b88acb7a8a4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:20.514305 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=38 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:20.633136 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] validate_networks() for [('39fcc75c-2eea-44a0-80cb-75ef2730abb8', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:29:21.023660 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:29:21.024080 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:29:21.024557 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:29:21.024955 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:29:21.025388 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:29:21.034669 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:21.034998 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:21.035777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:21.037103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:21.037688 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:21.038396 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:21.058512 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Getting quotas for project d5b4feb5fe1746a2b54b81e61558d4c0. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:29:21.062772 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Getting quotas for user b477645d5d814644aa77e11066f0489d and project d5b4feb5fe1746a2b54b81e61558d4c0. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:29:21.121257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:29:21.123409 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb151910-5f20-42c2-afbb-b88acb7a8a4e',volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:29:21.274463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-346b23cd-0e09-4173-9a71-acf991bed68b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.779478 Aug 09 11:29:21.275057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 237/479] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:29:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:29:21.286108 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6548c856-83a6-4093-81e1-6c8e46190f54 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:21.286735 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6548c856-83a6-4093-81e1-6c8e46190f54 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:21.345701 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6548c856-83a6-4093-81e1-6c8e46190f54 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:21.353383 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6548c856-83a6-4093-81e1-6c8e46190f54 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1088 microversion: 2.1 time: 0.071074 Aug 09 11:29:21.353954 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 243/480] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:21 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:21.405718 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:21.406335 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:21.413463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:21.413926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:21.414576 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:21.415304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:21.416354 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:21.416354 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:21.559470 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:21.568608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-086044a1-292a-4c8a-a617-eb0b05f2e70b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.166799 Aug 09 11:29:21.569181 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 238/481] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:21 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:22.374280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:22.374885 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:22.382461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:22.382977 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:22.383412 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:22.384100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:22.384549 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:22.384971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:22.445320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:22.453053 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4e5b2399-cb96-482a-9b84-479059b3e0bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1138 microversion: 2.1 time: 0.082705 Aug 09 11:29:22.453621 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 244/482] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:22 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:22.591790 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:22.592383 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:22.599562 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:22.600046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:22.600504 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:22.601166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:22.601597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:22.602037 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:22.748956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:22.756759 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e1e687ba-540d-445f-9533-53888a885c41 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.170264 Aug 09 11:29:22.757361 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 239/483] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:22 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:23.474144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:23.475039 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:23.481714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:23.482205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:23.482801 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:23.483542 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:23.483998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:23.484428 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:23.550420 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:23.558269 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8e13d118-864e-4da8-b5c2-c3d69ce927bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1138 microversion: 2.1 time: 0.088063 Aug 09 11:29:23.558865 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 245/484] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:23 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:29:23.786939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:23.787578 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:23.795138 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:23.795653 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:23.796116 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:23.796863 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:23.797288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:23.797728 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:23.931438 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:23.943100 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ea0418f9-3d67-4099-89a1-5430e13bb314 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.160237 Aug 09 11:29:23.943867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 240/485] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:23 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:24.580319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:24.580917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:24.587547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:24.588029 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:24.588458 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:24.589164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:24.589618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:24.590039 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:24.657722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:24.665971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e45a1b8a-de0b-4e07-9cd7-74e30571b231 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1138 microversion: 2.1 time: 0.089780 Aug 09 11:29:24.667599 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 246/486] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:24 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:24.967896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:24.968785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:24.975953 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:24.976375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:24.976810 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:24.977502 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:24.977986 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:24.978420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:25.110845 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:25.118708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f1c90523-f893-4e3b-9824-6f1a40d9cc75 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1369 microversion: 2.1 time: 0.156070 Aug 09 11:29:25.119301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 241/487] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:24 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:25.688563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:25.690094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:25.697825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:25.698559 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:25.699184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:25.700101 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:25.700553 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:25.701134 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:25.779481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:25.788891 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b8050621-5b48-4309-8645-5191e02ba9f4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1186 microversion: 2.1 time: 0.103801 Aug 09 11:29:25.788891 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 247/488] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:25 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1186 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:26.139416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:26.140049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:26.147584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:26.148415 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:26.148792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:26.149661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:26.150118 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:26.150545 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:26.289460 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:26.297305 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6242c855-c4f0-4346-9b81-e981524f0854 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1563 microversion: 2.1 time: 0.161700 Aug 09 11:29:26.298106 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 242/489] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:26 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:26.320587 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d8aee08c-2648-4f8b-bd4f-daa89d46f72d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:26.321577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d8aee08c-2648-4f8b-bd4f-daa89d46f72d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:26.329743 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=32 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:26.329743 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8aee08c-2648-4f8b-bd4f-daa89d46f72d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:26.329743 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8aee08c-2648-4f8b-bd4f-daa89d46f72d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:26.330158 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8aee08c-2648-4f8b-bd4f-daa89d46f72d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:26.330805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8aee08c-2648-4f8b-bd4f-daa89d46f72d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:26.331277 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8aee08c-2648-4f8b-bd4f-daa89d46f72d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:26.331860 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8aee08c-2648-4f8b-bd4f-daa89d46f72d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:26.421736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d8aee08c-2648-4f8b-bd4f-daa89d46f72d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105613 Aug 09 11:29:26.422355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 248/490] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 11:29:26 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:26.808859 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:26.809660 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:26.820422 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:26.821007 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:26.821552 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:26.823355 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:26.828605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:26.829207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:26.960057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:26.968220 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a19ea316-8e36-42d9-a7d1-010af49fcefa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1204 microversion: 2.1 time: 0.163143 Aug 09 11:29:26.969458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 243/491] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:26 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1204 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:27.522782 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-a0d242f4-51fc-43d4-abda-fdee020596dd req-685af576-d6c5-4251-a669-cd2fc44fc57e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c922f63-17a0-4421-bd4d-7a4430540a29", "tag": "d007e409-d8a8-4797-bfb3-ed337e9631c6"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:27.535088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a0d242f4-51fc-43d4-abda-fdee020596dd req-685af576-d6c5-4251-a669-cd2fc44fc57e service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:27.535561 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a0d242f4-51fc-43d4-abda-fdee020596dd req-685af576-d6c5-4251-a669-cd2fc44fc57e service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:27.535982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a0d242f4-51fc-43d4-abda-fdee020596dd req-685af576-d6c5-4251-a669-cd2fc44fc57e service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:27.548817 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-a0d242f4-51fc-43d4-abda-fdee020596dd req-685af576-d6c5-4251-a669-cd2fc44fc57e service nova] Creating event network-changed:d007e409-d8a8-4797-bfb3-ed337e9631c6 for instance 8c922f63-17a0-4421-bd4d-7a4430540a29 on hv-cinder-84989 Aug 09 11:29:27.557321 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-a0d242f4-51fc-43d4-abda-fdee020596dd req-685af576-d6c5-4251-a669-cd2fc44fc57e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038968 Aug 09 11:29:27.561515 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 249/492] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:27.991513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:27.993121 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:28.001872 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:28.002583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:28.003545 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:28.004475 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:28.005005 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:28.005318 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:28.190425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:28.203182 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a3153f0c-9ec5-4b62-a5f8-8996b547c779 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1272 microversion: 2.1 time: 0.215679 Aug 09 11:29:28.204471 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 244/493] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:27 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:28.500002 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e26cf6b8-8f82-4e39-b7cc-76303b3a289e req-b9dd86f7-177b-4bb1-a98a-e6124080ee0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dafb83be-fb97-4c38-9818-862de58903e2", "tag": "c7e24f87-826e-40ca-ae47-c2109c4d697b"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:28.510524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e26cf6b8-8f82-4e39-b7cc-76303b3a289e req-b9dd86f7-177b-4bb1-a98a-e6124080ee0b service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:28.511065 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e26cf6b8-8f82-4e39-b7cc-76303b3a289e req-b9dd86f7-177b-4bb1-a98a-e6124080ee0b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:28.511480 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e26cf6b8-8f82-4e39-b7cc-76303b3a289e req-b9dd86f7-177b-4bb1-a98a-e6124080ee0b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:28.528432 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e26cf6b8-8f82-4e39-b7cc-76303b3a289e req-b9dd86f7-177b-4bb1-a98a-e6124080ee0b service nova] Creating event network-changed:c7e24f87-826e-40ca-ae47-c2109c4d697b for instance dafb83be-fb97-4c38-9818-862de58903e2 on hv-cinder-84989 Aug 09 11:29:28.534041 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e26cf6b8-8f82-4e39-b7cc-76303b3a289e req-b9dd86f7-177b-4bb1-a98a-e6124080ee0b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037801 Aug 09 11:29:28.534853 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 250/494] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:29.231995 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:29.233258 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:29.240374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:29.240880 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:29.241320 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:29.242057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:29.242533 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:29.242986 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:29.390187 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:29.399738 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-88b731e2-1ef8-401d-ab4a-3ab0072f5b4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1272 microversion: 2.1 time: 0.171547 Aug 09 11:29:29.400336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 245/495] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:29 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:30.425047 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:30.425767 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:30.432113 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:30.432595 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:30.433046 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:30.433794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:30.434252 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:30.434688 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:30.574445 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:30.583643 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-59440243-0da4-4868-aef7-9f07b0384f01 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1272 microversion: 2.1 time: 0.165210 Aug 09 11:29:30.584209 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 251/496] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:30 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:31.608847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:31.609468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:31.611580 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:31.612463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:31.618218 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:31.618707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:31.619171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:31.619884 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:31.620375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:31.620796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:31.761144 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:31.768907 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-99be6a6b-e7c4-4a1c-b87c-d684cadad4b7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1272 microversion: 2.1 time: 0.167516 Aug 09 11:29:31.769477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 246/497] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:31 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:32.791889 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:32.792757 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:32.795316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:32.801379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:32.801874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:32.802309 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:32.803044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:32.803501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:32.803928 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:32.939899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:32.947525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9174977d-37fa-4717-b6cb-ef19cd854600 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1272 microversion: 2.1 time: 0.161269 Aug 09 11:29:32.948096 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 252/498] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:32 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:33.310232 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-148baf7f-c96f-464a-aee4-7b911d67f6ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: .version_select at 0x7fece2651e50>, body: {"keypair": {"name": "tempest-keypair-739312078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPKce0Le2oS6NOxBzEg/f+URtyC6teLJAHZnCmWG/kVWiELy1voF40lxQlIeVj4WMeuDsO1VSR1mDJmiRbAM7CwFmuthS1b81I3rPr2aSvKSGwgFT3hRskg/LmnaJ1WJg=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:33.326767 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-148baf7f-c96f-464a-aee4-7b911d67f6ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:29:33.330741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-148baf7f-c96f-464a-aee4-7b911d67f6ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for user 8512df3e232c4fd59b7abad4e6e05c9d and project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:29:33.353494 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-148baf7f-c96f-464a-aee4-7b911d67f6ad tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047142 Aug 09 11:29:33.354098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 247/499] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:29:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:33.969637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:33.970731 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:33.977706 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:33.978227 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:33.979784 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:33.979784 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:33.979995 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:33.980354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:34.132816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:34.141467 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4814e88f-0180-4077-b5f5-0157b46d49f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1272 microversion: 2.1 time: 0.176388 Aug 09 11:29:34.142077 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 253/500] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:33 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:29:34.712174 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2062064027", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f40c29ea-3de1-4291-8b2e-116412f586de"}], "security_groups": [{"name": "tempest-securitygroup--1171380838"}], "key_name": "tempest-keypair-739312078", "user_data": "}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:34.825651 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] validate_networks() for [('f40c29ea-3de1-4291-8b2e-116412f586de', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:29:35.164369 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:35.164994 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:35.171883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:35.172439 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:35.172872 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:35.173591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:35.174044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:35.174949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:35.293646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:29:35.294061 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:29:35.294525 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:29:35.294952 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:29:35.295344 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:29:35.304340 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:35.304835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:35.305260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:35.305978 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:35.306418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:35.306834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:35.324026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:29:35.328869 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for user 8512df3e232c4fd59b7abad4e6e05c9d and project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:29:35.336611 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:35.342220 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:29:35.344826 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:29:35.346339 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-dffb2405-8d35-47ea-b41c-c97b16c90641 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.186372 Aug 09 11:29:35.347133 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 254/501] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:35 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:35.391624 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d92fa984-e4cb-4a6b-ba85-bc4ab2cf281b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684493 Aug 09 11:29:35.392503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 248/502] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:29:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:29:35.404057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-408a35e1-218d-4a32-a6a1-1e4339358f0a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:35.405010 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-408a35e1-218d-4a32-a6a1-1e4339358f0a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:35.464162 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-408a35e1-218d-4a32-a6a1-1e4339358f0a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:35.478240 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-408a35e1-218d-4a32-a6a1-1e4339358f0a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1241 microversion: 2.1 time: 0.078444 Aug 09 11:29:35.479620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 255/503] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:35 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:36.380352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:36.380946 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:36.388992 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:36.389501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:36.389932 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:36.390627 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:36.391115 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:36.391528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:36.501254 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:36.502278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:36.510033 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:36.510528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:36.511142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:36.511859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:36.512290 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:36.512742 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:36.545134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:36.547625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:36.556172 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-543acf50-7c4c-4cc2-9e8c-ba74af8db6a3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.179763 Aug 09 11:29:36.556730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 249/504] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:36 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:36.579827 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:36.587655 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d26fca1e-48cd-46f1-bd2b-00169d7b83aa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1245 microversion: 2.1 time: 0.091697 Aug 09 11:29:36.588283 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 256/505] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:36 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:29:37.579747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:37.580531 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:37.589969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:37.590647 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:37.591300 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:37.592288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:37.593285 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:37.593907 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:37.609790 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:37.610386 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:37.617268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:37.617767 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:37.618169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:37.618893 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:37.619346 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:37.619856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:37.692104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:37.700710 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3d0ec78a-3b38-4b7c-8ce7-c43aa20d67c9 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1245 microversion: 2.1 time: 0.094490 Aug 09 11:29:37.701635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 257/506] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:37 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:37.758773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:37.766562 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a0bfcf9b-c7ae-4f21-95fe-db8e3b832030 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.192399 Aug 09 11:29:37.767198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 250/507] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:37 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:38.723009 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:38.723580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:38.730076 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:38.730557 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:38.731007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:38.731703 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:38.732127 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:38.732536 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:38.788306 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:38.788873 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:38.795766 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:38.796212 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:38.796377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:38.798176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:38.798176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:38.798176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:38.798452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:38.806397 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-faacdcaa-7b61-4a0d-8dff-345a8a08496f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1245 microversion: 2.1 time: 0.087356 Aug 09 11:29:38.815554 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 258/508] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:38 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:38.935508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:38.947256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ad4a4f9f-fd36-48a5-ae8d-816ec76c8465 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.162447 Aug 09 11:29:38.948151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 251/509] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:38 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:29:39.828839 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:39.829390 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:39.837029 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:39.837591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:39.838080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:39.838919 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:39.839413 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:39.839901 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:39.902463 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:39.910732 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7c369420-2c28-4e59-aa88-ec5a0156a238 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1245 microversion: 2.1 time: 0.086426 Aug 09 11:29:39.911318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 259/510] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:39 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:39.969611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:39.970220 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:39.979169 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:39.979651 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:39.980160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:39.981232 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:39.981432 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:39.982079 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:40.123330 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:40.131369 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ee94ec10-7697-43c1-a129-6ddf68472b14 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.166425 Aug 09 11:29:40.131990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 252/511] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:39 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:40.932684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:40.933247 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:40.940332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:40.940831 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:40.941326 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:40.942006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:40.942462 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:40.942917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:40.981031 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-939c1643-1b54-4fb8-a18d-6ecde4d2eda3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44d6055c-52f8-40e6-991e-ce054100290c", "device": "/dev/sdb"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:40.984715 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-939c1643-1b54-4fb8-a18d-6ecde4d2eda3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:40.991428 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939c1643-1b54-4fb8-a18d-6ecde4d2eda3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:40.991915 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939c1643-1b54-4fb8-a18d-6ecde4d2eda3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:40.992348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939c1643-1b54-4fb8-a18d-6ecde4d2eda3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:40.993133 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939c1643-1b54-4fb8-a18d-6ecde4d2eda3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:40.993509 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939c1643-1b54-4fb8-a18d-6ecde4d2eda3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:40.993936 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-939c1643-1b54-4fb8-a18d-6ecde4d2eda3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:41.005562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:41.013172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9f6a8e58-ce25-45c0-b353-9c3e4ac8af06 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1293 microversion: 2.1 time: 0.085377 Aug 09 11:29:41.013745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 260/512] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:40 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:41.153366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:41.154080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:41.160526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:41.161022 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:41.161454 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:41.162150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:41.162598 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:41.163040 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:41.165722 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:41.306371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:41.313954 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-286cadb6-993f-4a94-923c-e01a674e065c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.164532 Aug 09 11:29:41.314524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 261/513] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:41 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:29:41.375591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-939c1643-1b54-4fb8-a18d-6ecde4d2eda3 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "POST /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398386 Aug 09 11:29:41.376920 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 253/514] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:29:40 2022] POST /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:42.034284 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:42.035021 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:42.041781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:42.042367 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:42.042890 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:42.043588 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:42.044076 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:42.044481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:42.188016 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:42.196469 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-696d966c-aca5-468f-8d2e-f457b5e7c828 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.166153 Aug 09 11:29:42.197231 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 262/515] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:42 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:42.336737 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:42.337431 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:42.344012 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:42.344470 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:42.344864 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:42.345555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:42.346001 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:42.346668 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:42.514763 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:42.523261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cde83308-a53e-4550-a89c-27ca9806b249 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.191151 Aug 09 11:29:42.523831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 254/516] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:42 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:42.736418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e1c5c0de-a3e8-4cc3-b689-172ddc2178ec req-35b3a723-0237-4b10-8ff3-5e82fe25c8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d019a5ec-b564-47a3-a2fa-0970ad1bb2d4", "tag": "8e9a98d7-182b-415e-8021-9afa4e0711ca"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:42.747734 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e1c5c0de-a3e8-4cc3-b689-172ddc2178ec req-35b3a723-0237-4b10-8ff3-5e82fe25c8e4 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:42.748483 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e1c5c0de-a3e8-4cc3-b689-172ddc2178ec req-35b3a723-0237-4b10-8ff3-5e82fe25c8e4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:42.749135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e1c5c0de-a3e8-4cc3-b689-172ddc2178ec req-35b3a723-0237-4b10-8ff3-5e82fe25c8e4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:42.763499 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e1c5c0de-a3e8-4cc3-b689-172ddc2178ec req-35b3a723-0237-4b10-8ff3-5e82fe25c8e4 service nova] Creating event network-changed:8e9a98d7-182b-415e-8021-9afa4e0711ca for instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 on hv-cinder-84989 Aug 09 11:29:42.769648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e1c5c0de-a3e8-4cc3-b689-172ddc2178ec req-35b3a723-0237-4b10-8ff3-5e82fe25c8e4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037874 Aug 09 11:29:42.770360 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 263/517] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:43.218337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:43.219098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:43.226833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:43.227523 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:43.228137 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:43.228869 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:43.229317 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:43.229735 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:43.546089 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:43.546791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:43.559748 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:43.563141 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:43.563660 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:43.566309 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:43.567120 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:43.567647 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:43.569663 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:43.571533 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ba8fe566-67cc-45d8-8030-061c9e8b8c77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.357549 Aug 09 11:29:43.572584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 255/518] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:43 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:43.740420 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:43.748814 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-14a05b5f-9e7a-4d29-8549-c07c64430458 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.206949 Aug 09 11:29:43.749395 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 264/519] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:43 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:44.598856 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:44.599833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:44.610457 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:44.611100 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:44.611542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:44.612443 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:44.613140 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:44.613788 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:44.760582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:44.768668 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ddf4f3ef-d7c1-42fa-9f47-da89a953fb92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.178383 Aug 09 11:29:44.769239 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 256/520] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:44 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:44.770485 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:44.771186 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:44.777746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:44.778221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:44.778646 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:44.779366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:44.779781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:44.780216 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:44.916398 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:44.927165 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-41ffeb43-43ff-4331-899a-b739a60f0b74 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.160523 Aug 09 11:29:44.927749 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 265/521] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:44 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:29:45.790736 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:45.791431 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:45.793519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:45.794224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=10 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:45.801129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:45.801638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:45.802088 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:45.802847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:45.803329 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:45.803768 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:45.937624 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:45.946145 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-74adb617-750f-4b84-841f-4b65159c7668 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.159442 Aug 09 11:29:45.946986 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 257/522] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:45 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:45.954836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:45.955520 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:45.957985 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:45.964383 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:45.964866 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:45.965379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:45.966115 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:45.966568 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:45.967023 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:46.101044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:46.109642 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6d7b0ee3-3e46-4872-816c-b01cdbc052bc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.159236 Aug 09 11:29:46.110318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 266/523] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:45 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:46.969425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:46.970091 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:46.977909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:46.978450 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:46.978947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:46.979655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:46.980113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:46.980538 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:47.125338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:47.130748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:47.131644 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:47.133823 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f3af483f-f2a8-4243-9ad4-db1458ad4b70 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.168869 Aug 09 11:29:47.134416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 258/524] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:46 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:47.139763 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:47.140396 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:47.140965 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:47.141802 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:47.142392 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:47.143106 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:47.293871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:47.303684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b14d0469-0a4c-4533-8517-6a171d52a8f5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.176914 Aug 09 11:29:47.304384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 267/525] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:47 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:48.168698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:48.169361 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:48.176561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:48.177051 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:48.177480 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:48.178200 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:48.178653 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:48.179100 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:48.326563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:48.327202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:48.334433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:48.334957 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:48.335393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:48.336416 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:48.337010 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:48.337448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:48.341885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:48.350636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c4b12d0f-2b7b-47a6-a01b-f7344b6e2bd0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.185720 Aug 09 11:29:48.351265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 259/526] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:48 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:48.478861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:48.487409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cc28d9e1-9c69-4c82-b769-93c75911dc8b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.164744 Aug 09 11:29:48.487984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 268/527] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:48 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:49.373282 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:49.374554 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:49.381824 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:49.382317 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:49.382749 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:49.383493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:49.383948 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:49.384451 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:49.507764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:49.508377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:49.515398 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:49.515883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:49.516371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:49.517092 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:49.517546 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:49.518043 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:49.532929 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:49.541266 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-53698ec4-6c10-4127-8cdb-68937992e271 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.172940 Aug 09 11:29:49.541851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 260/528] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:49 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:49.659420 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:49.667755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cc2170d8-f34d-4e0c-b19c-90f152686127 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.163886 Aug 09 11:29:49.668340 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 269/529] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:49 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:29:50.047379 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-74e66880-3168-44fb-aafe-04e812b1e045 req-919e2563-cf0e-4169-a9b9-a0c255c98c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d019a5ec-b564-47a3-a2fa-0970ad1bb2d4", "name": "network-vif-plugged", "status": "completed", "tag": "8e9a98d7-182b-415e-8021-9afa4e0711ca"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:50.068991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-74e66880-3168-44fb-aafe-04e812b1e045 req-919e2563-cf0e-4169-a9b9-a0c255c98c59 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:50.069615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-74e66880-3168-44fb-aafe-04e812b1e045 req-919e2563-cf0e-4169-a9b9-a0c255c98c59 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:50.070189 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-74e66880-3168-44fb-aafe-04e812b1e045 req-919e2563-cf0e-4169-a9b9-a0c255c98c59 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:50.104912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-74e66880-3168-44fb-aafe-04e812b1e045 req-919e2563-cf0e-4169-a9b9-a0c255c98c59 service nova] Creating event network-vif-plugged:8e9a98d7-182b-415e-8021-9afa4e0711ca for instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 on hv-cinder-84989 Aug 09 11:29:50.111948 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-74e66880-3168-44fb-aafe-04e812b1e045 req-919e2563-cf0e-4169-a9b9-a0c255c98c59 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071720 Aug 09 11:29:50.112553 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 261/530] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:50.561925 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:50.562502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:50.569760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:50.570247 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:50.570684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:50.571428 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:50.571886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:50.572315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:50.690249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:50.690987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:50.693180 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:50.699580 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:50.700366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:50.700894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:50.701507 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:50.701955 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:50.702460 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:50.722886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:50.733393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-dbb4fb1d-cee7-4937-b0e4-7adbc357fb01 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.175379 Aug 09 11:29:50.734287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 270/531] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:50 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:50.854635 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:50.863096 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6084ed8b-a626-4b8b-963b-ad00751b55cb tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.177890 Aug 09 11:29:50.863688 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 262/532] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:50 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:51.753980 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:51.754583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:51.761464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:51.761947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:51.762404 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:51.763151 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:51.763607 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:51.764031 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:51.884566 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:51.885182 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:51.891982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:51.892455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:51.892885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:51.892885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:51.894040 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:51.894431 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:51.923027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:51.931779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3689cd5e-6295-4bfe-84f0-de0656a9ad92 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.181670 Aug 09 11:29:51.932407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 271/533] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:51 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:52.051418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:52.059324 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5bfaca42-dedd-43c2-8c6f-68778afdd2bf tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.179020 Aug 09 11:29:52.059900 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 263/534] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:51 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:29:52.953279 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:52.954081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:52.961867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:52.962366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:52.962797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:52.963546 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:52.964003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:52.964425 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:53.080224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:53.080896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:53.088308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:53.088787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:53.089211 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:53.089908 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:53.090366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:53.090779 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:53.106743 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:53.114804 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c8a258f9-c064-4641-8b4b-7c2f82b7a45f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.165637 Aug 09 11:29:53.115409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 272/535] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:52 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:53.231197 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:53.240106 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-14f0dcf4-33a2-4b75-8a59-ac6b6559bd36 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.163746 Aug 09 11:29:53.240696 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 264/536] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:53 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:54.135913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:54.136484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:54.143459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:54.143951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:54.144381 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:54.145071 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:54.145557 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:54.145975 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:54.264503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:54.265089 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:54.272141 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:54.272625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:54.273055 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:54.273795 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:54.274211 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:54.274657 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:54.292917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:54.300694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1070d9fd-e5a2-46e0-890b-493bce64376b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.168627 Aug 09 11:29:54.301338 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 273/537] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:54 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:54.412249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:54.414611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:54.421448 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5981da6c-a4fe-4386-b12b-35db2fe5522c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.160868 Aug 09 11:29:54.422086 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 265/538] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:54 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:55.322524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:55.323139 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:55.330879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:55.331478 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:55.332022 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:55.332779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:55.333264 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:55.333839 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:55.443778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:55.444681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:55.453111 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:55.453670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:55.454216 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:55.455164 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:55.455698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:55.456206 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:55.473898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:55.485971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-92301ff6-0b7a-45a7-adc9-e40e64ff7b98 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.167860 Aug 09 11:29:55.486536 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 274/539] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:55 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:55.598899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:55.607238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-054ec269-bd7b-45e8-83bf-c8f665acc644 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.169237 Aug 09 11:29:55.607803 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 266/540] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:55 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:56.462630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-61b3aa66-9209-4181-8ff2-72eb5c17c58d req-5fefa327-a1a8-4d17-ac5b-ca5eea3d7026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafb83be-fb97-4c38-9818-862de58903e2", "name": "network-vif-plugged", "status": "completed", "tag": "c7e24f87-826e-40ca-ae47-c2109c4d697b"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:56.468720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=56 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:56.476614 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-61b3aa66-9209-4181-8ff2-72eb5c17c58d req-5fefa327-a1a8-4d17-ac5b-ca5eea3d7026 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:56.476614 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-61b3aa66-9209-4181-8ff2-72eb5c17c58d req-5fefa327-a1a8-4d17-ac5b-ca5eea3d7026 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:56.476614 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-61b3aa66-9209-4181-8ff2-72eb5c17c58d req-5fefa327-a1a8-4d17-ac5b-ca5eea3d7026 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:56.495609 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-61b3aa66-9209-4181-8ff2-72eb5c17c58d req-5fefa327-a1a8-4d17-ac5b-ca5eea3d7026 service nova] Creating event network-vif-plugged:c7e24f87-826e-40ca-ae47-c2109c4d697b for instance dafb83be-fb97-4c38-9818-862de58903e2 on hv-cinder-84989 Aug 09 11:29:56.501939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-61b3aa66-9209-4181-8ff2-72eb5c17c58d req-5fefa327-a1a8-4d17-ac5b-ca5eea3d7026 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042184 Aug 09 11:29:56.501939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 275/541] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:56.508058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:56.508710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:56.520965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:56.521605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:56.522039 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:56.522739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:56.523223 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:56.523644 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:56.628804 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:56.629796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:56.636505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:56.636981 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:56.637594 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:56.638474 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:56.638969 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:56.639397 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:56.669618 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:56.678240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-12f5f51c-9889-4466-a597-da990181bcea tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1367 microversion: 2.1 time: 0.173697 Aug 09 11:29:56.692119 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 267/542] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:56 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:56.798949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:56.807429 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-22fafc1c-fd46-469e-8e0b-81685add3c04 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.182832 Aug 09 11:29:56.814748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 276/543] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:56 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:57.701579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:57.702443 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:57.711927 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:57.712607 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:57.713220 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:57.714199 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:57.714867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:57.715492 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:57.829240 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:57.829840 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:57.836743 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:57.837244 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:57.840325 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:57.840325 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:57.840325 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:57.840325 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:57.858755 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:57.867119 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0d6580f0-9c29-470b-a27c-0204f08d8264 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1557 microversion: 2.1 time: 0.171021 Aug 09 11:29:57.867710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 268/544] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:57 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:57.888704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d6e6a2a0-1222-4873-ae3e-eb45108d55eb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:57.889190 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d6e6a2a0-1222-4873-ae3e-eb45108d55eb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:57.895665 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2a0-1222-4873-ae3e-eb45108d55eb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:57.896133 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2a0-1222-4873-ae3e-eb45108d55eb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:57.896561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2a0-1222-4873-ae3e-eb45108d55eb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:57.897256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2a0-1222-4873-ae3e-eb45108d55eb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:57.897695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2a0-1222-4873-ae3e-eb45108d55eb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:57.898111 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2a0-1222-4873-ae3e-eb45108d55eb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:57.994704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d6e6a2a0-1222-4873-ae3e-eb45108d55eb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110249 Aug 09 11:29:57.995479 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 269/545] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 11:29:57 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:58.014101 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:58.022100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b9a379e0-45f4-4588-aa6b-86bd81fe1387 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.197299 Aug 09 11:29:58.028502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 277/546] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:57 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:29:58.994365 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-94939321-ec37-47ca-9268-01b21034d731 req-7b277a64-4bd2-4e54-a89a-96e30364e7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d019a5ec-b564-47a3-a2fa-0970ad1bb2d4", "tag": "8e9a98d7-182b-415e-8021-9afa4e0711ca"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:29:59.004506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-94939321-ec37-47ca-9268-01b21034d731 req-7b277a64-4bd2-4e54-a89a-96e30364e7a7 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:59.004990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-94939321-ec37-47ca-9268-01b21034d731 req-7b277a64-4bd2-4e54-a89a-96e30364e7a7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:59.005481 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-94939321-ec37-47ca-9268-01b21034d731 req-7b277a64-4bd2-4e54-a89a-96e30364e7a7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:59.018280 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-94939321-ec37-47ca-9268-01b21034d731 req-7b277a64-4bd2-4e54-a89a-96e30364e7a7 service nova] Creating event network-changed:8e9a98d7-182b-415e-8021-9afa4e0711ca for instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 on hv-cinder-84989 Aug 09 11:29:59.024447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-94939321-ec37-47ca-9268-01b21034d731 req-7b277a64-4bd2-4e54-a89a-96e30364e7a7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034081 Aug 09 11:29:59.025081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 270/547] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:29:59.049228 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:29:59.049834 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:29:59.056859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:59.057424 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:59.057855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:59.058560 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:29:59.059035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:29:59.059453 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:29:59.199071 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:29:59.206696 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6d121ec1-96e8-49db-a4a2-13a68111b8a7 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.161457 Aug 09 11:29:59.207322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 278/548] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:29:59 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:30:00.228760 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:00.229514 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:00.237052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:00.237585 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:00.238021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:00.238727 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:00.239209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:00.239632 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:00.382680 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:00.389938 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-061eaee4-865c-4a88-84a2-fcab441ad744 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.165534 Aug 09 11:30:00.390539 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 271/549] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:00 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:01.410674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:01.411329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:01.421729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:01.422248 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:01.422715 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:01.423474 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:01.423967 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:01.424385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:01.427395 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:01.562501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:01.570283 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-df0160b5-5afe-44bd-9177-4aa391a1638c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.163562 Aug 09 11:30:01.570871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 279/550] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:01 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:02.591210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:02.591810 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:02.599371 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:02.599832 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:02.600241 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:02.600948 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:02.601394 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:02.601814 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:02.743238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:02.754906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-76e2232a-120f-4c49-8e32-0be116eb3006 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.167494 Aug 09 11:30:02.755524 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 272/551] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:02 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:03.775909 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:03.776477 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:03.783481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:03.783969 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:03.784387 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:03.785112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:03.785541 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:03.785989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:03.922761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:03.930858 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d02a9333-f408-44b9-8fd8-73db87ac6888 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.158927 Aug 09 11:30:03.931472 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 280/552] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:03 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:04.953043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:04.953730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:04.961247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:04.961747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:04.962181 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:04.962913 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:04.963397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:04.963817 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:05.109952 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:05.118230 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-75d347ac-655a-4465-b8e9-1b9f0854a183 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.169043 Aug 09 11:30:05.118845 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 273/553] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:04 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:06.145394 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:06.146244 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:06.155478 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:06.156139 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:06.156825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:06.157763 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:06.158255 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:06.158706 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:06.316505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:06.326446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2c7c4a7f-f870-4890-b4b5-9af742a3d633 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.186311 Aug 09 11:30:06.327428 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 281/554] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:06 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:07.354106 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:07.354710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:07.361740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:07.362257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:07.362693 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:07.363429 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:07.363882 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:07.364306 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:07.500321 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:07.508094 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1a020656-2a3f-45d0-a3f1-c5898c43283b tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.158021 Aug 09 11:30:07.508660 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 274/555] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:07 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:08.538051 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:08.538648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:08.547737 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:08.548466 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:08.548951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:08.550016 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:08.550681 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:08.551328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:08.703425 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:08.710971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a533bd94-2c04-4590-8c36-7c42123f334e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1260 microversion: 2.1 time: 0.178354 Aug 09 11:30:08.711653 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 282/556] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:08 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:09.732939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:09.733642 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:09.740066 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:09.740539 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:09.740960 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:09.741639 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:09.742081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:09.742527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:09.875096 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:09.883078 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fb6fdf71-74c2-4b3f-87a5-96e3578fd444 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1444 microversion: 2.1 time: 0.154116 Aug 09 11:30:09.883702 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 275/557] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:09 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:09.906562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:09.907668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:09.916506 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:09.916992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:09.917447 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:09.918154 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:09.918612 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:09.919071 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:10.062180 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:10.070583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6beba80a-e2ce-4bda-8800-297e4c898e67 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1444 microversion: 2.1 time: 0.170241 Aug 09 11:30:10.071194 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 283/558] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:09 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1444 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:11.943267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-08ce09eb-4348-40be-b931-e393555fd412 req-b604ff5a-72cf-4e69-87df-991842ee68ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dafb83be-fb97-4c38-9818-862de58903e2", "tag": "c7e24f87-826e-40ca-ae47-c2109c4d697b"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:11.953270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-08ce09eb-4348-40be-b931-e393555fd412 req-b604ff5a-72cf-4e69-87df-991842ee68ed service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:11.954069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-08ce09eb-4348-40be-b931-e393555fd412 req-b604ff5a-72cf-4e69-87df-991842ee68ed service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:11.954496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-08ce09eb-4348-40be-b931-e393555fd412 req-b604ff5a-72cf-4e69-87df-991842ee68ed service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:11.966130 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-08ce09eb-4348-40be-b931-e393555fd412 req-b604ff5a-72cf-4e69-87df-991842ee68ed service nova] Creating event network-changed:c7e24f87-826e-40ca-ae47-c2109c4d697b for instance dafb83be-fb97-4c38-9818-862de58903e2 on hv-cinder-84989 Aug 09 11:30:11.971861 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-08ce09eb-4348-40be-b931-e393555fd412 req-b604ff5a-72cf-4e69-87df-991842ee68ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032011 Aug 09 11:30:11.972338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 276/559] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:30:12.632442 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:12.633178 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:12.639870 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:12.640354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:12.640767 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:12.641451 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:12.642009 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:12.642317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:12.784973 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lazy-loading 'services' on Instance uuid b9983eb2-0da6-452f-9608-55b4c87fd1da {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:30:12.905011 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8f292f5f-df99-4157-833b-bd5af20ed37c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da/os-volume_attachments/44d6055c-52f8-40e6-991e-ce054100290c" status: 202 len: 0 microversion: 2.1 time: 0.276389 Aug 09 11:30:12.905751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 284/560] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:30:12 2022] DELETE /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da/os-volume_attachments/44d6055c-52f8-40e6-991e-ce054100290c => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:30:15.102594 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:15.103386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:15.110626 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.111136 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.111785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.112477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.112925 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.113348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.139106 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:30:15.217845 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1e5db87c-6c1d-482d-88c1-37d5c3d56c2c tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 204 len: 0 microversion: 2.1 time: 0.119646 Aug 09 11:30:15.218459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 277/561] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:30:15 2022] DELETE /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:30:15.228049 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:15.228802 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:15.235110 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.235589 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.236020 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.236713 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:15.237163 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:15.238051 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:15.373319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:15.380972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-30787794-6732-4eef-9c55-013342ecaa78 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1514 microversion: 2.1 time: 0.157782 Aug 09 11:30:15.381544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 285/562] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:15 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:16.402470 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:16.403198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:16.411036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:16.411529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:16.412081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:16.412802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:16.413251 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:16.413671 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:16.551263 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:16.562638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6d3d3e3b-2d91-4de1-8547-1a141e0d8abf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1514 microversion: 2.1 time: 0.164483 Aug 09 11:30:16.563515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 278/563] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:16 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:17.586163 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:17.586773 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:17.594209 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:17.594701 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:17.595250 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:17.595952 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:17.596405 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:17.596890 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:17.733497 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:17.742191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e3b2d34e-26b9-4629-9d7d-ac2095fd6eaf tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1514 microversion: 2.1 time: 0.160239 Aug 09 11:30:17.742804 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 286/564] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:17 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:18.203304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-af2526f4-05d5-4c83-8a15-fe0548a48c8a req-44e73a55-e044-488b-9d92-ab899ca6c6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9983eb2-0da6-452f-9608-55b4c87fd1da", "name": "network-vif-deleted", "tag": "e34c8cd6-1bc8-43a8-ad42-b51f869a4cce"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:18.215033 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-af2526f4-05d5-4c83-8a15-fe0548a48c8a req-44e73a55-e044-488b-9d92-ab899ca6c6c4 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:18.215442 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-af2526f4-05d5-4c83-8a15-fe0548a48c8a req-44e73a55-e044-488b-9d92-ab899ca6c6c4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:18.215878 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-af2526f4-05d5-4c83-8a15-fe0548a48c8a req-44e73a55-e044-488b-9d92-ab899ca6c6c4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:18.238063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-af2526f4-05d5-4c83-8a15-fe0548a48c8a req-44e73a55-e044-488b-9d92-ab899ca6c6c4 service nova] Creating event network-vif-deleted:e34c8cd6-1bc8-43a8-ad42-b51f869a4cce for instance b9983eb2-0da6-452f-9608-55b4c87fd1da on hv-cinder-84989 Aug 09 11:30:18.246009 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-af2526f4-05d5-4c83-8a15-fe0548a48c8a req-44e73a55-e044-488b-9d92-ab899ca6c6c4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046349 Aug 09 11:30:18.246721 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 279/565] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:30:18.763670 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:18.764274 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:18.771243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:18.771754 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:18.772175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:18.772889 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:18.773363 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:18.773879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:18.805593 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:18.806174 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:18.806606 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:18.807003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lazy-loading 'fault' on Instance uuid b9983eb2-0da6-452f-9608-55b4c87fd1da {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:30:18.853281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:18.861197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-db748d05-fea2-41ad-b56c-a7b8794c8081 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 200 len: 1309 microversion: 2.1 time: 0.101391 Aug 09 11:30:18.861786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 287/566] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:18 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:19.883509 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:19.884213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: b9983eb2-0da6-452f-9608-55b4c87fd1da] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:19.891043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:19.891523 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:19.891958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:19.892648 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:19.893095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:19.893524 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:19.907471 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] HTTP exception thrown: Instance b9983eb2-0da6-452f-9608-55b4c87fd1da could not be found. Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Request method failure captured: Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da HTTP/1.1 Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kTT4PUTaLdR1DRXPAzQmTLOFYeyaCJHTHmj2OrkBgTqF6P6UDY0SP-g7zY4M2rYsSuylps1mxt-5JEoqik6KkO9AFXCA87_rgxIRcVkUZRrTW4dMSxa4knVSaEgC6CQ85lNROPpP143g-IL_l8936CiYIbOlhiwrNNTObKACaRXR14 Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: ef17bd64c2e648c5b0e4543e635e3d7a Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-VolumesSnapshotTestJSON-263759059 Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:30:19.909168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef17bd64c2e648c5b0e4543e635e3d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef17bd64c2e648c5b0e4543e635e3d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ef17bd64c2e648c5b0e4543e635e3d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ef17bd64c2e648c5b0e4543e635e3d7a", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-VolumesSnapshotTestJSON-263759059 Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: ef17bd64c2e648c5b0e4543e635e3d7a Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-263759059 Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-VolumesSnapshotTestJSON-263759059-project Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 50e392889ece4517a139dfde15fcb208 Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-VolumesSnapshotTestJSON-263759059-project Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance b9983eb2-0da6-452f-9608-55b4c87fd1da could not be found. Aug 09 11:30:19.910870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'b9983eb2-0da6-452f-9608-55b4c87fd1da'} Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9983eb2-0da6-452f-9608-55b4c87fd1da could not be found. Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:30:19.911641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9983eb2-0da6-452f-9608-55b4c87fd1da could not be found. Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9983eb2-0da6-452f-9608-55b4c87fd1da could not be found. Aug 09 11:30:19.912910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:30:19.914046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Returning 404 to user: Instance b9983eb2-0da6-452f-9608-55b4c87fd1da could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:30:19.914046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5a8b9440-9d93-4aea-be4a-7698abd00d79 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da" status: 404 len: 111 microversion: 2.1 time: 0.031941 Aug 09 11:30:19.914046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 280/567] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:19 2022] GET /compute/v2.1/servers/b9983eb2-0da6-452f-9608-55b4c87fd1da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:30:31.937821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-101069521", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "networks": [{"uuid": "7c1f5109-d487-4765-86e5-fb0ecb5ba983"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:31.948376 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=27 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:31.949864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:32.007056 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] validate_networks() for [('7c1f5109-d487-4765-86e5-fb0ecb5ba983', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:30:32.403905 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:30:32.404414 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:30:32.404962 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:30:32.405448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:30:32.406028 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:30:32.417402 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:32.417867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:32.418355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:32.420796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:32.421309 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:32.421891 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:32.440502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Getting quotas for project ef17bd64c2e648c5b0e4543e635e3d7a. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:30:32.446023 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Getting quotas for user 50e392889ece4517a139dfde15fcb208 and project ef17bd64c2e648c5b0e4543e635e3d7a. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:30:32.458002 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:30:32.460335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:30:32.515307 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0b4acf1a-baab-4329-878b-f48e02801016 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581646 Aug 09 11:30:32.516311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 288/568] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:30:32.529074 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-76c90cc5-c628-441b-ae38-12b4856496e9 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:32.529783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-76c90cc5-c628-441b-ae38-12b4856496e9 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:32.532272 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:32.535397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:32.601397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-76c90cc5-c628-441b-ae38-12b4856496e9 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:32.609666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-76c90cc5-c628-441b-ae38-12b4856496e9 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1218 microversion: 2.1 time: 0.085304 Aug 09 11:30:32.611489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 281/569] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:32 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:33.637457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:33.638300 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:33.646990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:33.647483 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:33.647890 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:33.648605 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:33.649062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:33.649489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:33.719261 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:33.728687 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-922ec9cc-17af-4307-b449-1f6450d103ba tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1270 microversion: 2.1 time: 0.095706 Aug 09 11:30:33.729265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 289/570] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:33 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:34.751456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:34.753912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:34.766777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:34.767364 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:34.767796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:34.768533 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:34.769202 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:34.769621 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:34.951429 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:34.960667 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2ed7cd1b-e432-442c-8647-efe7bc7f18e0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1318 microversion: 2.1 time: 0.213687 Aug 09 11:30:34.961253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 282/571] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:34 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:35.251643 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-10b8d946-6264-4f2d-aff9-ce16d9285f70 req-145fc8d6-57db-4916-a924-de1be7c93857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f682407-e7c0-44b6-bdd9-1212f8d0eef0", "tag": "187d371a-9d61-4932-80f2-1d73c39906db"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:35.268798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-10b8d946-6264-4f2d-aff9-ce16d9285f70 req-145fc8d6-57db-4916-a924-de1be7c93857 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:35.269900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-10b8d946-6264-4f2d-aff9-ce16d9285f70 req-145fc8d6-57db-4916-a924-de1be7c93857 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:35.270341 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-10b8d946-6264-4f2d-aff9-ce16d9285f70 req-145fc8d6-57db-4916-a924-de1be7c93857 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:35.290149 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-10b8d946-6264-4f2d-aff9-ce16d9285f70 req-145fc8d6-57db-4916-a924-de1be7c93857 service nova] Creating event network-changed:187d371a-9d61-4932-80f2-1d73c39906db for instance 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 on hv-cinder-84989 Aug 09 11:30:35.296458 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-10b8d946-6264-4f2d-aff9-ce16d9285f70 req-145fc8d6-57db-4916-a924-de1be7c93857 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051792 Aug 09 11:30:35.297586 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 290/572] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:30:35.982012 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:35.982601 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:35.989834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:35.990302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:35.990745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:35.991516 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:35.991965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:35.992376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:36.140042 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:36.147966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-abbfbb17-9c0e-4d7c-8f00-897edc747599 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1318 microversion: 2.1 time: 0.169949 Aug 09 11:30:36.148541 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 283/573] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:35 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:30:37.170347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:37.171190 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:37.177709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:37.178123 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:37.178551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:37.179271 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:37.179717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:37.180136 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:37.323184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:37.332511 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6542f9e3-6152-4721-876e-aa3d121b6269 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1318 microversion: 2.1 time: 0.166685 Aug 09 11:30:37.333510 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 291/574] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:37 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:38.354951 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:38.355787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:38.362271 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:38.362765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:38.363221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:38.363908 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:38.364341 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:38.364762 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:38.533555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:38.546423 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-09c1bd48-fabc-481f-9e35-02c28c3d4477 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1318 microversion: 2.1 time: 0.195931 Aug 09 11:30:38.547733 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 284/575] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:38 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:39.568379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:39.569133 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:39.576310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:39.577070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:39.577742 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:39.579183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:39.579800 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:39.580440 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:39.725205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:39.732726 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f01183be-acb5-46cf-b409-8894f14253ed tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1318 microversion: 2.1 time: 0.169149 Aug 09 11:30:39.733271 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 292/576] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:39 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:40.753823 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:40.754372 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:40.761240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:40.761708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:40.762147 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:40.762852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:40.763307 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:40.763698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:40.910647 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:40.918840 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ff598603-84ad-4613-8d07-8f418968cfe0 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1318 microversion: 2.1 time: 0.168947 Aug 09 11:30:40.919767 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 285/577] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:40 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:41.040821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-6c83a3fd-28b9-41a9-887b-695fb10250e2 req-53e7738c-53b8-49da-b532-0c1091355143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f682407-e7c0-44b6-bdd9-1212f8d0eef0", "name": "network-vif-plugged", "status": "completed", "tag": "187d371a-9d61-4932-80f2-1d73c39906db"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:41.051568 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6c83a3fd-28b9-41a9-887b-695fb10250e2 req-53e7738c-53b8-49da-b532-0c1091355143 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:41.052061 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6c83a3fd-28b9-41a9-887b-695fb10250e2 req-53e7738c-53b8-49da-b532-0c1091355143 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:41.052522 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6c83a3fd-28b9-41a9-887b-695fb10250e2 req-53e7738c-53b8-49da-b532-0c1091355143 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:41.064013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-6c83a3fd-28b9-41a9-887b-695fb10250e2 req-53e7738c-53b8-49da-b532-0c1091355143 service nova] Creating event network-vif-plugged:187d371a-9d61-4932-80f2-1d73c39906db for instance 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 on hv-cinder-84989 Aug 09 11:30:41.069594 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-6c83a3fd-28b9-41a9-887b-695fb10250e2 req-53e7738c-53b8-49da-b532-0c1091355143 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Aug 09 11:30:41.070200 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 293/578] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:30:41.939957 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:41.940550 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:41.947724 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:41.948221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:41.948655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:41.949357 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:41.949808 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:41.950236 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:42.083821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:42.092059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e1039f08-8059-41b0-b1db-3a2501aeb2fe tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1318 microversion: 2.1 time: 0.156111 Aug 09 11:30:42.092641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 286/579] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:41 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:43.112434 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:43.113470 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:43.119937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:43.121003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:43.128889 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:43.129380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:43.129809 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:43.130515 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:43.131016 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:43.131441 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:43.282005 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:43.290314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3a561536-4a09-4a8f-9a1f-cf72646bcba5 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1318 microversion: 2.1 time: 0.180470 Aug 09 11:30:43.290914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 294/580] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:43 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:44.313352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:44.313932 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:44.315847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:44.321887 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:44.322373 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:44.322805 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:44.323561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:44.324014 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:44.324436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:44.455310 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:30:44.463513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2a4a90b1-7b30-4483-bb7f-2713dd19e294 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1508 microversion: 2.1 time: 0.154132 Aug 09 11:30:44.464071 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 287/581] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:30:44 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:30:44.484429 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bc460588-4c15-40ba-9b75-00c462718459 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c88317e2-5180-474f-9c7a-1e9572698e4e", "device": "/dev/sdb"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:44.487285 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bc460588-4c15-40ba-9b75-00c462718459 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:44.494134 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc460588-4c15-40ba-9b75-00c462718459 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:44.494618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc460588-4c15-40ba-9b75-00c462718459 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:44.495105 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc460588-4c15-40ba-9b75-00c462718459 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:44.495803 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc460588-4c15-40ba-9b75-00c462718459 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:44.496244 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc460588-4c15-40ba-9b75-00c462718459 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:44.496659 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc460588-4c15-40ba-9b75-00c462718459 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:44.806284 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bc460588-4c15-40ba-9b75-00c462718459 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "POST /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325746 Aug 09 11:30:44.806935 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 295/582] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:30:44 2022] POST /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:30:55.594837 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-071ffea1-126a-40c5-901d-c9a817f957c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:30:55.595330 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-071ffea1-126a-40c5-901d-c9a817f957c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:55.597984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=16 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:55.598909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=36 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:55.604095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071ffea1-126a-40c5-901d-c9a817f957c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:55.604588 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071ffea1-126a-40c5-901d-c9a817f957c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:55.605021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071ffea1-126a-40c5-901d-c9a817f957c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:55.605719 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071ffea1-126a-40c5-901d-c9a817f957c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:55.606174 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071ffea1-126a-40c5-901d-c9a817f957c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:55.606649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071ffea1-126a-40c5-901d-c9a817f957c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:55.632051 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-071ffea1-126a-40c5-901d-c9a817f957c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/ips" status: 200 len: 145 microversion: 2.1 time: 0.041415 Aug 09 11:30:55.632634 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 288/583] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:30:55 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:30:58.700403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:58.701145 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:58.705826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-08773b7c-112c-4602-9c12-1867f408be58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfa36a9a-e2d0-4657-986a-3b44a5129708"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:30:58.708377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-08773b7c-112c-4602-9c12-1867f408be58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:30:58.716500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-08773b7c-112c-4602-9c12-1867f408be58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:58.716984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-08773b7c-112c-4602-9c12-1867f408be58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:58.717511 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-08773b7c-112c-4602-9c12-1867f408be58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:58.718201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-08773b7c-112c-4602-9c12-1867f408be58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:30:58.718652 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-08773b7c-112c-4602-9c12-1867f408be58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:30:58.719095 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-08773b7c-112c-4602-9c12-1867f408be58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:30:59.195733 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-08773b7c-112c-4602-9c12-1867f408be58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496663 Aug 09 11:30:59.196481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 296/584] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:30:58 2022] POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:31:08.371477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:08.371993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:08.374194 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:08.374867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:08.382136 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:08.382635 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:08.383105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:08.384307 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:08.385016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:08.385612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:08.594312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lazy-loading 'services' on Instance uuid 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:31:08.721354 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4207dbf8-78ff-42af-bf96-b96e13eb134d tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0/os-volume_attachments/c88317e2-5180-474f-9c7a-1e9572698e4e" status: 202 len: 0 microversion: 2.1 time: 0.353771 Aug 09 11:31:08.721954 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 289/585] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:31:08 2022] DELETE /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0/os-volume_attachments/c88317e2-5180-474f-9c7a-1e9572698e4e => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:31:12.206986 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:12.207728 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:12.211705 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:12.212321 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:12.219468 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:12.219951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:12.220378 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:12.221155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:12.221547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:12.221958 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:12.248843 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:31:12.249518 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a611fca2-b581-44ae-894a-9bbe1e8639ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:31:12.256059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a611fca2-b581-44ae-894a-9bbe1e8639ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:12.256542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a611fca2-b581-44ae-894a-9bbe1e8639ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:12.256972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a611fca2-b581-44ae-894a-9bbe1e8639ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:12.318341 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a611fca2-b581-44ae-894a-9bbe1e8639ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Going to try to stop instance {{(pid=117792) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 11:31:12.326869 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-90bf2351-9f78-4973-9c37-5892bbe06d57 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 204 len: 0 microversion: 2.1 time: 0.121140 Aug 09 11:31:12.327498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 297/586] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:31:12 2022] DELETE /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:31:12.336041 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:12.336983 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:12.343860 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:12.344340 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:12.344753 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:12.345475 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:12.345957 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:12.346417 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:12.369115 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a611fca2-b581-44ae-894a-9bbe1e8639ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/action" status: 202 len: 0 microversion: 2.1 time: 0.125115 Aug 09 11:31:12.370054 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 290/587] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:31:12 2022] POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:31:12.378802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:12.379734 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:12.388885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:12.389396 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:12.389919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:12.390623 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:12.391098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:12.391519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:12.768937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:12.776656 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-758bd48e-8ea1-41a0-864c-3db9fbdff803 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1514 microversion: 2.1 time: 0.444661 Aug 09 11:31:12.777238 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 298/588] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:12 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1514 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:31:12.799043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:12.807565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-10430085-1e22-46dd-acae-90e2666dd067 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.433273 Aug 09 11:31:12.808134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 291/589] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:12 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:31:13.799573 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:13.799573 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:13.807168 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:13.807714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:13.808176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:13.809067 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:13.809577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:13.810053 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:13.830189 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:13.831152 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:13.838295 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:13.838783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:13.839448 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:13.840954 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:13.841637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:13.842230 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:14.014074 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:14.021916 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d91779ed-5285-4463-82f5-eb79da3fee32 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1514 microversion: 2.1 time: 0.227834 Aug 09 11:31:14.022691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 299/590] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:13 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:14.039772 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:14.047805 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-90894282-1164-4aa4-bd44-1759037e25f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.222099 Aug 09 11:31:14.048357 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 292/591] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:13 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:15.042364 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:15.043089 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:15.050619 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:15.051191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:15.051630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:15.052334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:15.052793 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:15.053061 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-023b58d2-77ad-4c8d-a567-88a567029d76 req-3889f4cf-d427-4b1c-8beb-579a4dbee358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f682407-e7c0-44b6-bdd9-1212f8d0eef0", "name": "network-vif-deleted", "tag": "187d371a-9d61-4932-80f2-1d73c39906db"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:31:15.053523 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:15.063954 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-023b58d2-77ad-4c8d-a567-88a567029d76 req-3889f4cf-d427-4b1c-8beb-579a4dbee358 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:15.064444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-023b58d2-77ad-4c8d-a567-88a567029d76 req-3889f4cf-d427-4b1c-8beb-579a4dbee358 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:15.064841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-023b58d2-77ad-4c8d-a567-88a567029d76 req-3889f4cf-d427-4b1c-8beb-579a4dbee358 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:15.076853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-023b58d2-77ad-4c8d-a567-88a567029d76 req-3889f4cf-d427-4b1c-8beb-579a4dbee358 service nova] Creating event network-vif-deleted:187d371a-9d61-4932-80f2-1d73c39906db for instance 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 on hv-cinder-84989 Aug 09 11:31:15.082487 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-023b58d2-77ad-4c8d-a567-88a567029d76 req-3889f4cf-d427-4b1c-8beb-579a4dbee358 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033186 Aug 09 11:31:15.083145 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 293/592] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:31:15.089150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:15.090281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:15.096672 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:15.097151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:15.097578 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:15.098446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:15.098932 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:15.099528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:15.124569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e392889ece4517a139dfde15fcb208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef17bd64c2e648c5b0e4543e635e3d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:15.132592 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b12337c2-e1a8-4753-8686-61b44f13e24f tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 200 len: 1472 microversion: 2.1 time: 0.094084 Aug 09 11:31:15.133390 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 300/593] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:15 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:15.237231 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:15.245285 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-968be526-ad3c-43a7-ad77-a77877a93b2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.160867 Aug 09 11:31:15.245850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 294/594] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:15 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:16.155852 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:16.156755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] [instance: 3f682407-e7c0-44b6-bdd9-1212f8d0eef0] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:16.164325 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:16.164831 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:16.165256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:16.165968 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:16.166410 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:16.166840 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:16.180324 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] HTTP exception thrown: Instance 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 could not be found. Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Request method failure captured: Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 HTTP/1.1 Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kTT4PUTaLdR1DRXPAzQmTLOFYeyaCJHTHmj2OrkBgTqF6P6UDY0SP-g7zY4M2rYsSuylps1mxt-5JEoqik6KkO9AFXCA87_rgxIRcVkUZRrTW4dMSxa4knVSaEgC6CQ85lNROPpP143g-IL_l8936CiYIbOlhiwrNNTObKACaRXR14 Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: ef17bd64c2e648c5b0e4543e635e3d7a Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesSnapshotTestJSON-263759059 Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:31:16.181963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef17bd64c2e648c5b0e4543e635e3d7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef17bd64c2e648c5b0e4543e635e3d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ef17bd64c2e648c5b0e4543e635e3d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ef17bd64c2e648c5b0e4543e635e3d7a", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesSnapshotTestJSON-263759059 Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: ef17bd64c2e648c5b0e4543e635e3d7a Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-263759059 Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesSnapshotTestJSON-263759059-project Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 50e392889ece4517a139dfde15fcb208 Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesSnapshotTestJSON-263759059-project Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 could not be found. Aug 09 11:31:16.183500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '3f682407-e7c0-44b6-bdd9-1212f8d0eef0'} Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 could not be found. Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:31:16.184280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 could not be found. Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 could not be found. Aug 09 11:31:16.185635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:16.186756 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] Returning 404 to user: Instance 3f682407-e7c0-44b6-bdd9-1212f8d0eef0 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:31:16.186756 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2c14c8a3-99aa-4424-8fc9-7366afc20641 tempest-VolumesSnapshotTestJSON-263759059 tempest-VolumesSnapshotTestJSON-263759059-project] 10.222.0.59 "GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0" status: 404 len: 111 microversion: 2.1 time: 0.032557 Aug 09 11:31:16.186756 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 301/595] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:16 2022] GET /compute/v2.1/servers/3f682407-e7c0-44b6-bdd9-1212f8d0eef0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:31:16.266477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:16.267101 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:16.274066 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:16.274501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:16.275066 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:16.275793 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:16.276249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:16.276668 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:16.422435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:16.426756 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ca48a5c7-4968-459e-89a9-b7d0d49aef4d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.164102 Aug 09 11:31:16.441386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 295/596] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:16 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:17.448823 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:17.449417 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:17.456187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:17.456665 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:17.457095 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:17.457781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:17.458300 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:17.458645 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:17.592664 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:17.600904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5e336068-f1a9-4aa5-93ce-28df4400cc92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.156055 Aug 09 11:31:17.602018 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 302/597] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:17 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:18.624015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:18.624663 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:18.631568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:18.632052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:18.632486 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:18.633176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:18.633615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:18.634035 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:18.769570 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:18.777769 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2c535ab2-2906-4f66-90c1-f4aabffc67a6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.158094 Aug 09 11:31:18.778331 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 296/598] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:18 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:19.799875 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:19.800755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:19.807462 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:19.807947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:19.808386 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:19.809089 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:19.809567 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:19.809962 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:19.959243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:19.971879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b0d6fa92-8e48-4d86-8a04-806d23cf7851 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.176037 Aug 09 11:31:19.972717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 303/599] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:19 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:21.003112 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:21.003733 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:21.010586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:21.011112 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:21.011754 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:21.012704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:21.013330 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:21.013800 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:21.151146 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:21.159957 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f6618336-2b90-47d8-936e-567e70277a5c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.161417 Aug 09 11:31:21.160550 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 297/600] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:20 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:22.181304 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:22.181910 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:22.188940 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:22.189462 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:22.189936 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:22.190690 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:22.191178 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:22.191633 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:22.346806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:22.360256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-38d57e4d-8b76-4168-a23b-eb2807132ac6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.182817 Aug 09 11:31:22.360984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 304/601] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:22 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:23.385226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:23.386089 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:23.396091 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:23.396818 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:23.397490 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:23.398571 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:23.399306 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:23.399979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:23.547454 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:23.555789 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-191e7d1c-34a4-445b-af2e-df714b63a403 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.177026 Aug 09 11:31:23.556395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 298/602] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:23 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:24.577819 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:24.578427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:24.585532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:24.586017 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:24.586452 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:24.587298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:24.587758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:24.588188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:24.742640 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:24.751817 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7fa15588-416e-40e3-8dd7-f9f7de25debb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.177972 Aug 09 11:31:24.752402 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 305/603] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:24 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:25.773432 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:25.774007 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:25.781057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:25.781540 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:25.781975 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:25.782673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:25.783150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:25.783563 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:25.920017 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:25.928418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-312581e0-d856-4ce9-a7a5-f654c2a701da tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.158862 Aug 09 11:31:25.928890 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 299/604] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:25 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:31:26.949810 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:26.951627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:26.958544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:26.959267 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:26.965871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:26.966606 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:26.967109 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:26.967563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:27.105990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:27.117652 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-74266f84-4f7e-4a50-9725-9f41cd8351f1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.171676 Aug 09 11:31:27.118409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 306/605] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:26 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:28.145387 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:28.145987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:28.152752 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:28.153259 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:28.153679 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:28.154352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:28.154835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:28.155255 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:28.298119 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:28.306683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-756c86f6-c1a0-4fbf-be41-209e87591cd5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.165372 Aug 09 11:31:28.307287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 300/606] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:28 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:29.330958 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:29.331654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:29.340676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:29.341259 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:29.341770 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:29.342845 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:29.343260 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:29.343808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:29.480053 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:29.488692 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-464c6548-eb55-41de-9583-be4880022f02 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.162478 Aug 09 11:31:29.489269 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 307/607] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:29 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:30.510992 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:30.511623 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:30.519071 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:30.519562 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:30.519980 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:30.520683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:30.521137 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:30.521566 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:30.660939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:30.669368 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-07e52237-c88c-425a-8e62-90e472b7257d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.162336 Aug 09 11:31:30.669946 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 301/608] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:30 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:31.691879 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:31.692575 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:31.699499 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:31.699993 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:31.700405 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:31.701060 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:31.701518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:31.701933 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:31.838962 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:31.851204 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8cf049d6-1361-46bf-9571-5f192e19f290 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.163097 Aug 09 11:31:31.851992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 308/609] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:31 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:32.873187 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:32.873931 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:32.880364 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:32.880855 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:32.881289 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:32.882049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:32.882498 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:32.882957 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:33.027439 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:33.036224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6901a23d-bb83-4d5d-b791-a33db692619e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.167595 Aug 09 11:31:33.036797 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 302/610] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:32 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:34.058083 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:34.058888 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:34.066794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:34.067147 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:34.067403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:34.068109 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:34.068560 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:34.068985 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:34.211272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:34.219901 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-499c5e74-0121-432c-9c01-0f4d8aa76232 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1724 microversion: 2.1 time: 0.166124 Aug 09 11:31:34.220477 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 309/611] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:34 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:35.241652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:35.242266 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:35.249311 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:35.249797 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:35.250227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:35.250966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:35.251420 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:35.251842 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:35.392619 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:35.400576 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-645184f2-9ff7-4d3b-8f1f-febdd4f2072e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1701 microversion: 2.1 time: 0.162842 Aug 09 11:31:35.401145 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 303/612] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:35 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:35.421849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a12cdb63-d75c-4136-af66-e79eb550012c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:31:35.428734 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a12cdb63-d75c-4136-af66-e79eb550012c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:35.429246 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a12cdb63-d75c-4136-af66-e79eb550012c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:35.429701 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a12cdb63-d75c-4136-af66-e79eb550012c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:35.494988 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a12cdb63-d75c-4136-af66-e79eb550012c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Going to try to start instance {{(pid=117793) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 11:31:35.542262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a12cdb63-d75c-4136-af66-e79eb550012c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/action" status: 202 len: 0 microversion: 2.1 time: 0.124496 Aug 09 11:31:35.543098 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 310/613] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:31:35 2022] POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:31:35.552059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:35.552898 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:35.563536 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:35.564539 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:35.565523 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:35.565913 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:35.566367 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:35.566791 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:35.595105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:35.725334 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:35.734913 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a5950dc2-4799-4701-85eb-b37896ece53d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1710 microversion: 2.1 time: 0.187240 Aug 09 11:31:35.735510 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 304/614] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:35 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1710 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:36.759317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:36.759978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:36.767472 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:36.768004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:36.768493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:36.769287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:36.769795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:36.770243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:36.792147 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:36.917230 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:36.926282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-310be600-60ba-4fa3-a1d1-2633819b5d41 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1710 microversion: 2.1 time: 0.172566 Aug 09 11:31:36.926842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 311/615] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:36 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1710 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:37.951923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:37.952763 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:37.962584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:37.963107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:37.963615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:37.964846 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:37.965484 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:37.966013 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:38.120951 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:38.129333 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-84e0ed37-7fa8-44e2-85f3-3a830f87760d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1714 microversion: 2.1 time: 0.183316 Aug 09 11:31:38.129901 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 305/616] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:37 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1714 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:56.737983 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:56.738803 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:56.991460 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3c252fb0-ea40-408b-9ef3-bfebbb68a59b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69fc5377-37d0-46d4-afeb-140a87001870"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:31:56.994444 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3c252fb0-ea40-408b-9ef3-bfebbb68a59b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:57.002354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c252fb0-ea40-408b-9ef3-bfebbb68a59b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:57.003150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c252fb0-ea40-408b-9ef3-bfebbb68a59b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:57.003771 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c252fb0-ea40-408b-9ef3-bfebbb68a59b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:57.005339 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c252fb0-ea40-408b-9ef3-bfebbb68a59b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:57.005693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c252fb0-ea40-408b-9ef3-bfebbb68a59b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:57.006128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3c252fb0-ea40-408b-9ef3-bfebbb68a59b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:57.799346 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3c252fb0-ea40-408b-9ef3-bfebbb68a59b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.066175 Aug 09 11:31:57.801958 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 312/617] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:31:56 2022] POST /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments => generated 194 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:31:58.198612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=34 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:58.199730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=8 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:58.323985 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9675c2cc-9957-4f84-b905-c14e05702f91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:58.324526 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9675c2cc-9957-4f84-b905-c14e05702f91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:58.331579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9675c2cc-9957-4f84-b905-c14e05702f91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:58.332267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9675c2cc-9957-4f84-b905-c14e05702f91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:58.332872 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9675c2cc-9957-4f84-b905-c14e05702f91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:58.333744 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9675c2cc-9957-4f84-b905-c14e05702f91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:58.334351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9675c2cc-9957-4f84-b905-c14e05702f91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:58.334988 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9675c2cc-9957-4f84-b905-c14e05702f91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:58.364563 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9675c2cc-9957-4f84-b905-c14e05702f91 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4/ips" status: 200 len: 150 microversion: 2.1 time: 0.172211 Aug 09 11:31:58.365700 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 306/618] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:31:58 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4/ips => generated 150 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:31:58.378424 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85dc2fd4-d356-4d21-a374-2bf78b5a1c7d"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:31:58.380941 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:58.388033 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:58.388805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:58.389236 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:58.389955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:58.390399 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:58.390865 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:58.509583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Invalid volume: volume 85dc2fd4-d356-4d21-a374-2bf78b5a1c7d is already attached to instances: 47718566-e01b-41e5-bdc1-ba691dc04c2c Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4/os-volume_attachments HTTP/1.1 Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 74 Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:31:58.511792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {"volumeAttachment": {"volumeId": "85dc2fd4-d356-4d21-a374-2bf78b5a1c7d"}} Aug 09 11:31:58.514637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Invalid volume: volume 85dc2fd4-d356-4d21-a374-2bf78b5a1c7d is already attached to instances: 47718566-e01b-41e5-bdc1-ba691dc04c2c Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'server_id': 'd019a5ec-b564-47a3-a2fa-0970ad1bb2d4', 'body': {'volumeAttachment': {'volumeId': '85dc2fd4-d356-4d21-a374-2bf78b5a1c7d'}}} Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 85dc2fd4-d356-4d21-a374-2bf78b5a1c7d is already attached to instances: 47718566-e01b-41e5-bdc1-ba691dc04c2c Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:58.516301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 85dc2fd4-d356-4d21-a374-2bf78b5a1c7d is already attached to instances: 47718566-e01b-41e5-bdc1-ba691dc04c2c Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:31:58.518859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:31:58.521438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:31:58.521438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:31:58.521438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:31:58.521438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 85dc2fd4-d356-4d21-a374-2bf78b5a1c7d is already attached to instances: 47718566-e01b-41e5-bdc1-ba691dc04c2c Aug 09 11:31:58.521438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:31:58.521438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 400 to user: Invalid volume: volume 85dc2fd4-d356-4d21-a374-2bf78b5a1c7d is already attached to instances: 47718566-e01b-41e5-bdc1-ba691dc04c2c {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:31:58.521438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d0476143-036c-4380-942e-58a12fe1a3cd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140470 Aug 09 11:31:58.524850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:58.525397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:58.528578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 313/619] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:31:58 2022] POST /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:31:58.532542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:58.533518 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:58.534434 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:58.536612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:58.537385 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:58.538024 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:58.578257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:31:58.687255 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a1f991dc-4b80-40e5-9f35-3b93172d2a16 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 204 len: 0 microversion: 2.1 time: 0.166926 Aug 09 11:31:58.692307 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 307/620] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:31:58 2022] DELETE /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:31:58.699691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:58.700912 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:31:58.711369 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:58.711927 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:58.712493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:58.718320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:31:58.719255 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:31:58.719995 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:31:58.890299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:31:58.903527 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4d675299-ce04-4b12-b9a3-b29ecbb694fc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1682 microversion: 2.1 time: 0.208852 Aug 09 11:31:58.905326 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 314/621] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:58 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:31:59.949465 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:31:59.955882 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:00.006402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:00.030899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:00.030899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:00.030899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:00.030899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:00.031449 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:00.318436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:00.328685 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-572f02d4-f39e-495c-a1ac-88286bc16b0d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1682 microversion: 2.1 time: 0.392169 Aug 09 11:32:00.329314 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 308/622] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:31:59 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1682 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:01.353371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:01.355198 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:01.364183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:01.367152 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:01.367717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:01.368621 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:01.369282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:01.369752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:01.583091 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:01.598055 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ceaf0234-4422-4c48-a923-61eac3641c30 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1682 microversion: 2.1 time: 0.249638 Aug 09 11:32:01.600579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 315/623] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:01 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:02.416592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-7b379ae8-d32c-4103-9ef9-49d02f1625e8 req-fd57370c-5366-4c67-bf4b-31b33d670932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d019a5ec-b564-47a3-a2fa-0970ad1bb2d4", "name": "network-vif-deleted", "tag": "8e9a98d7-182b-415e-8021-9afa4e0711ca"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:02.428618 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7b379ae8-d32c-4103-9ef9-49d02f1625e8 req-fd57370c-5366-4c67-bf4b-31b33d670932 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:02.429094 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7b379ae8-d32c-4103-9ef9-49d02f1625e8 req-fd57370c-5366-4c67-bf4b-31b33d670932 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:02.429514 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7b379ae8-d32c-4103-9ef9-49d02f1625e8 req-fd57370c-5366-4c67-bf4b-31b33d670932 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:02.456216 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-7b379ae8-d32c-4103-9ef9-49d02f1625e8 req-fd57370c-5366-4c67-bf4b-31b33d670932 service nova] Creating event network-vif-deleted:8e9a98d7-182b-415e-8021-9afa4e0711ca for instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 on hv-cinder-84989 Aug 09 11:32:02.462294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-7b379ae8-d32c-4103-9ef9-49d02f1625e8 req-fd57370c-5366-4c67-bf4b-31b33d670932 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256070 Aug 09 11:32:02.463740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 309/624] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:02.621146 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:02.623218 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:02.636465 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:02.663409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:02.663876 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:02.664656 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:02.676888 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:02.677340 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:02.744907 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:02.745797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:02.757936 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:02.758929 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lazy-loading 'fault' on Instance uuid d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:32:02.837540 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:02.846560 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-271e9a84-4021-4eca-9330-5bc8db343893 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 200 len: 1331 microversion: 2.1 time: 0.231128 Aug 09 11:32:02.849118 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 316/625] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:02 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 1331 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:03.871624 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:03.872412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:03.887264 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:03.887833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:03.888273 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:03.889004 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:03.889464 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:03.889897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:03.910346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 HTTP/1.1 Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:32:03.912508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:32:03.914261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'd019a5ec-b564-47a3-a2fa-0970ad1bb2d4'} Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:32:03.915056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:32:03.916338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:32:03.923588 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:32:03.924770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-31cae8e1-07dc-4eab-91c9-4277ae735c10 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 404 len: 111 microversion: 2.1 time: 0.057593 Aug 09 11:32:03.926162 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 310/626] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:03 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:32:03.934975 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-41d8921c-428e-4be6-8274-c1980561ffcb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '.version_select at 0x7fece3192820>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:03.996079 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-41d8921c-428e-4be6-8274-c1980561ffcb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-739312078" status: 202 len: 0 microversion: 2.1 time: 0.063621 Aug 09 11:32:03.997588 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 317/627] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Aug 9 11:32:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-739312078 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:32:04.348412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-74cb3428-12f9-41cd-82f5-cf4a47a1147c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Action: 'create', calling method: .version_select at 0x7fece251d700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1525815280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx6GBj9iCR3DrPhu0Nfo0yO/lLcQfyEEyHSo15/emyLX2zz9z061USVeiajS+eoymxVhLHV1HWFlEYJ09aEWQ62Sa6ZNocUmzz6GzwZ8T9TuhIREbayfgaOLE5pSsDvCA=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:04.366848 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-74cb3428-12f9-41cd-82f5-cf4a47a1147c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Getting quotas for project 0a9c360edd3f46a6bc20bcb78b174478. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:32:04.371427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-74cb3428-12f9-41cd-82f5-cf4a47a1147c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Getting quotas for user 443ee5d3b542498a8aa78716287f5d83 and project 0a9c360edd3f46a6bc20bcb78b174478. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:32:04.394466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR oslo.messaging._drivers.impl_rabbit [None req-74cb3428-12f9-41cd-82f5-cf4a47a1147c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [139a8e1a-3a5e-48de-9ce3-ec7b51dbc826] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 11:32:05.077839 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:05.078406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:05.084440 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:05.084915 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:05.085345 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:05.086026 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:05.086476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:05.086910 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:05.174795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lazy-loading 'services' on Instance uuid 47718566-e01b-41e5-bdc1-ba691dc04c2c {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:32:05.253768 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ee86dde9-72c2-4c58-b5ec-8ae964bb9237 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments/85dc2fd4-d356-4d21-a374-2bf78b5a1c7d" status: 202 len: 0 microversion: 2.1 time: 0.180032 Aug 09 11:32:05.254363 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 318/628] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:32:05 2022] DELETE /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments/85dc2fd4-d356-4d21-a374-2bf78b5a1c7d => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:32:05.264937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7acf8870-78d5-433b-b64e-d86ec2b70b58 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:05.267329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7acf8870-78d5-433b-b64e-d86ec2b70b58 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:05.273868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7acf8870-78d5-433b-b64e-d86ec2b70b58 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:05.274354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7acf8870-78d5-433b-b64e-d86ec2b70b58 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:05.274787 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7acf8870-78d5-433b-b64e-d86ec2b70b58 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:05.275536 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7acf8870-78d5-433b-b64e-d86ec2b70b58 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:05.275992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7acf8870-78d5-433b-b64e-d86ec2b70b58 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:05.276416 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7acf8870-78d5-433b-b64e-d86ec2b70b58 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:05.307587 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7acf8870-78d5-433b-b64e-d86ec2b70b58 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048227 Aug 09 11:32:05.308150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 319/629] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:32:05 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:32:05.403283 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [None req-74cb3428-12f9-41cd-82f5-cf4a47a1147c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [139a8e1a-3a5e-48de-9ce3-ec7b51dbc826] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 47182. Aug 09 11:32:05.422035 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-74cb3428-12f9-41cd-82f5-cf4a47a1147c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.078276 Aug 09 11:32:05.422650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 311/630] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:32:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:05.481731 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1018814919", "imageRef": "cb84d32e-2888-4c09-b991-0a052fb312b9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1525815280", "networks": [{"uuid": "ee57feed-26ee-4b3b-a636-1a4f8b59c3b6"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:05.538869 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] validate_networks() for [('ee57feed-26ee-4b3b-a636-1a4f8b59c3b6', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:32:06.064713 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:32:06.065292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:32:06.066029 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:32:06.066524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:32:06.066966 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:32:06.077630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:06.078201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:06.078732 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:06.079295 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:06.079937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:06.080540 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:06.103003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Getting quotas for project 0a9c360edd3f46a6bc20bcb78b174478. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:32:06.107414 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Getting quotas for user 443ee5d3b542498a8aa78716287f5d83 and project 0a9c360edd3f46a6bc20bcb78b174478. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:32:06.120694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:32:06.123342 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb84d32e-2888-4c09-b991-0a052fb312b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:32:06.169283 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4274a673-9f91-4071-8efb-b78c89dfc50d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691530 Aug 09 11:32:06.170359 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 320/631] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 11:32:06.181704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c0f2208f-40df-408c-870f-0e0f100633fd tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:06.182317 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c0f2208f-40df-408c-870f-0e0f100633fd tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:06.243686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c0f2208f-40df-408c-870f-0e0f100633fd tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:06.250658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c0f2208f-40df-408c-870f-0e0f100633fd tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1259 microversion: 2.1 time: 0.073303 Aug 09 11:32:06.251226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 312/632] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:06 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:06.320050 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8a63b427-4c66-4187-a9d4-de595f8b0cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:06.322335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8a63b427-4c66-4187-a9d4-de595f8b0cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:06.330997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a63b427-4c66-4187-a9d4-de595f8b0cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:06.331593 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a63b427-4c66-4187-a9d4-de595f8b0cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:06.332191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a63b427-4c66-4187-a9d4-de595f8b0cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:06.333079 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a63b427-4c66-4187-a9d4-de595f8b0cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:06.333635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a63b427-4c66-4187-a9d4-de595f8b0cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:06.334164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a63b427-4c66-4187-a9d4-de595f8b0cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:06.370117 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8a63b427-4c66-4187-a9d4-de595f8b0cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054118 Aug 09 11:32:06.370683 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 321/633] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:32:06 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:06.821009 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:06.824292 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:06.834284 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:06.834731 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:06.835291 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:06.835979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:06.836447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:06.836936 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:06.861773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lazy-loading 'flavor' on Instance uuid 8c922f63-17a0-4421-bd4d-7a4430540a29 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:32:07.002912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7c42d5d9-b15e-40d6-96f7-d58eb69e8b69 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/action" status: 200 len: 32 microversion: 2.1 time: 0.186094 Aug 09 11:32:07.003541 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 313/634] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:32:06 2022] POST /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:32:07.014635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:07.015582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:07.024997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:07.025805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:07.026460 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:07.028307 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:07.029049 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:07.029549 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:07.184076 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:07.193094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e6fffacc-63a3-47f5-8744-b7b794b3f0d0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.183705 Aug 09 11:32:07.193664 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 322/635] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:07 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:07.275756 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-802ad586-ac81-46db-b2c6-f95eb1dbd46d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:07.276433 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-802ad586-ac81-46db-b2c6-f95eb1dbd46d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:07.338738 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-802ad586-ac81-46db-b2c6-f95eb1dbd46d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:07.348438 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-802ad586-ac81-46db-b2c6-f95eb1dbd46d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1259 microversion: 2.1 time: 0.077233 Aug 09 11:32:07.350859 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 314/636] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:07 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1259 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:07.381679 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-52b0f876-bf65-49c3-a159-57cb47593aed tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:07.383910 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-52b0f876-bf65-49c3-a159-57cb47593aed tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:07.389931 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52b0f876-bf65-49c3-a159-57cb47593aed tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:07.390672 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52b0f876-bf65-49c3-a159-57cb47593aed tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:07.391103 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52b0f876-bf65-49c3-a159-57cb47593aed tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:07.392027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52b0f876-bf65-49c3-a159-57cb47593aed tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:07.392678 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52b0f876-bf65-49c3-a159-57cb47593aed tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:07.393108 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52b0f876-bf65-49c3-a159-57cb47593aed tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:07.437225 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-52b0f876-bf65-49c3-a159-57cb47593aed tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059501 Aug 09 11:32:07.437799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 323/637] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:32:07 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:32:07.510158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:07.510650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:07.519633 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:07.520126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:07.520554 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:07.521254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:07.521703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:07.522124 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:07.547133 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:32:07.625963 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cf8c67a5-6896-43f5-a184-4ff7d70d7fc7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 204 len: 0 microversion: 2.1 time: 0.119339 Aug 09 11:32:07.626925 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 315/638] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:32:07 2022] DELETE /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:32:07.635404 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:07.636013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:07.642379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:07.642874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:07.643303 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:07.644010 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:07.644474 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:07.644902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:07.798011 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:07.811294 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91cdf4e3-34d5-470b-b956-9423e3ab7ff2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1678 microversion: 2.1 time: 0.179567 Aug 09 11:32:07.812065 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 324/639] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:07 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:08.216290 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:08.216960 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:08.223632 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:08.224125 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:08.224555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:08.225266 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:08.225717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:08.226166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:08.369883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-11f780e7-19d4-4906-88fc-43b98caaba55 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:08.370591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-11f780e7-19d4-4906-88fc-43b98caaba55 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:08.382847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:08.391711 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cb11a933-8e0f-4b24-914f-9f54902aa6e2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.180089 Aug 09 11:32:08.392652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 316/640] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:08 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:08.428984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-11f780e7-19d4-4906-88fc-43b98caaba55 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:08.436170 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-11f780e7-19d4-4906-88fc-43b98caaba55 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1259 microversion: 2.1 time: 0.070327 Aug 09 11:32:08.436715 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 325/641] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:08 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:08.833854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:08.834377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:08.841762 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:08.842245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:08.842675 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:08.843394 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:08.843850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:08.844269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:08.980966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:08.989938 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-71b039ac-8b91-42b3-a156-c0e14658a041 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1678 microversion: 2.1 time: 0.159970 Aug 09 11:32:08.990497 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 317/642] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:08 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:09.413939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:09.414630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:09.423366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:09.423880 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:09.424349 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:09.425026 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:09.425490 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:09.425968 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:09.456850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e029fd18-db00-41a1-899b-380433a2e84b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:09.457845 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e029fd18-db00-41a1-899b-380433a2e84b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:09.558869 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e029fd18-db00-41a1-899b-380433a2e84b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:09.566500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e029fd18-db00-41a1-899b-380433a2e84b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1259 microversion: 2.1 time: 0.113420 Aug 09 11:32:09.568399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 318/643] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:09 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1259 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:09.586144 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-4c5d308e-7e07-468a-8662-f91e288a19e2 req-e3edb58f-c4e0-4e8d-b192-c1bd5d07aec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47718566-e01b-41e5-bdc1-ba691dc04c2c", "name": "network-vif-deleted", "tag": "a4cec858-ffac-4590-8c8f-19f2d2926a37"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:09.599765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4c5d308e-7e07-468a-8662-f91e288a19e2 req-e3edb58f-c4e0-4e8d-b192-c1bd5d07aec7 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:09.600662 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4c5d308e-7e07-468a-8662-f91e288a19e2 req-e3edb58f-c4e0-4e8d-b192-c1bd5d07aec7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:09.601243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4c5d308e-7e07-468a-8662-f91e288a19e2 req-e3edb58f-c4e0-4e8d-b192-c1bd5d07aec7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:09.622612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-4c5d308e-7e07-468a-8662-f91e288a19e2 req-e3edb58f-c4e0-4e8d-b192-c1bd5d07aec7 service nova] Creating event network-vif-deleted:a4cec858-ffac-4590-8c8f-19f2d2926a37 for instance 47718566-e01b-41e5-bdc1-ba691dc04c2c on hv-cinder-84989 Aug 09 11:32:09.628488 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-4c5d308e-7e07-468a-8662-f91e288a19e2 req-e3edb58f-c4e0-4e8d-b192-c1bd5d07aec7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058881 Aug 09 11:32:09.629108 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 319/644] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:09.673069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:09.685733 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2537d277-4404-4e57-b74e-d2fa2ec54d0b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.274635 Aug 09 11:32:09.686961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 326/645] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:09 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:10.012236 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:10.013048 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:10.019883 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:10.020677 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:10.021180 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:10.021974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:10.022495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:10.023002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:10.056139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:10.056612 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:10.057076 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:10.057518 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lazy-loading 'fault' on Instance uuid 47718566-e01b-41e5-bdc1-ba691dc04c2c {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:32:10.103113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:10.110979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a7ae85ad-c61f-4ea5-9ae3-7b63e02429d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 200 len: 1329 microversion: 2.1 time: 0.103250 Aug 09 11:32:10.111565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 320/646] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:10 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:10.588866 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:10.589673 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:10.596550 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:10.597032 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:10.597643 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:10.598341 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:10.598788 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:10.599227 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:10.660890 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:10.669098 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-62ae0358-42ab-40cb-9217-d6eb6fae4141 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1263 microversion: 2.1 time: 0.084536 Aug 09 11:32:10.669667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 327/647] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:10 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:10.707479 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:10.708028 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:10.715372 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:10.715908 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:10.716353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:10.717004 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:10.717539 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:10.717897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:10.858631 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:10.867134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e818807e-0a9f-4490-8578-ec652bf7cbb0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.163480 Aug 09 11:32:10.867707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 321/648] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:10 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:11.139245 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:11.140274 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:11.151750 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:11.152509 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:11.153279 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:11.154032 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:11.154546 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:11.155058 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:11.171741 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c HTTP/1.1 Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:32:11.173427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:32:11.174739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '47718566-e01b-41e5-bdc1-ba691dc04c2c'} Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:32:11.175512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:32:11.176847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:11.178067 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:32:11.178067 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f11395d0-db89-4791-b6ce-2c6994b3de78 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 404 len: 111 microversion: 2.1 time: 0.043868 Aug 09 11:32:11.178067 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 328/649] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:11 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:32:11.185039 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cba37059-f46e-4996-b829-1a8b8e302af3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '.version_select at 0x7fece2608820>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:11.205367 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cba37059-f46e-4996-b829-1a8b8e302af3 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-644904299" status: 202 len: 0 microversion: 2.1 time: 0.024413 Aug 09 11:32:11.205917 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 322/650] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Aug 9 11:32:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-644904299 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:32:11.690706 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:11.692241 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:11.702498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:11.703160 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:11.703910 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:11.704617 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:11.705072 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:11.705629 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:11.726278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:11.787276 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:11.798721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-caed5175-2e96-4bea-a51a-6b9e2e278346 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1317 microversion: 2.1 time: 0.112861 Aug 09 11:32:11.799336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 329/651] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:11 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1317 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:11.893113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:11.894474 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:11.904000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:11.905159 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:11.906147 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:11.907617 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:11.908709 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:11.909620 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:11.967801 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-714e52b6-6a17-43fd-b9f9-46548885de08 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: .version_select at 0x7fece2da1940>, body: {"keypair": {"name": "tempest-keypair-2064405743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDthkUz3/O9zZzdNXwdYPJoxdkt0R0vc0NsvbAArT7f6Hy8qsk4U2kAN4iWmrvZ1eAlSIH01rSB1KyTFVJup1U/N54SVMUebn0fzBokhw8jRjKpRiKnqeW4ZYobphsuJPQ=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:11.999267 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-714e52b6-6a17-43fd-b9f9-46548885de08 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:32:12.003698 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-714e52b6-6a17-43fd-b9f9-46548885de08 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for user 8512df3e232c4fd59b7abad4e6e05c9d and project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:32:12.042058 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-714e52b6-6a17-43fd-b9f9-46548885de08 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081094 Aug 09 11:32:12.042636 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 330/652] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:32:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:32:12.089680 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:12.099176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-774fede5-a727-4e2c-a4ef-075a58b6753e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.214552 Aug 09 11:32:12.099908 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 323/653] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:11 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:12.828578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:12.830474 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:12.842140 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:12.843667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:12.845212 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:12.846406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:12.847388 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:12.848255 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:13.055902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:13.063883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aaa346cd-e1f2-43e2-b842-3ace8118b6ce tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.245478 Aug 09 11:32:13.064544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 331/654] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:12 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:13.122525 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:13.123181 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:13.130390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:13.131026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:13.131462 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:13.132226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:13.132762 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:13.133173 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:13.137711 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:13.395269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:13.405692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f90cfba4-e5ba-4c40-9874-e5de8b1c7cb5 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.287485 Aug 09 11:32:13.407834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 324/655] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:13 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:14.085852 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:14.086540 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:14.094208 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:14.094693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:14.095153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:14.095885 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:14.096299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:14.096718 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:14.220638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-899030719", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f40c29ea-3de1-4291-8b2e-116412f586de"}], "security_groups": [{"name": "tempest-securitygroup--1572374595"}], "key_name": "tempest-keypair-2064405743", "user_data": "}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:14.321233 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:14.330324 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a15a8018-8c50-46ef-9777-0544e4e0eb2a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.248401 Aug 09 11:32:14.333999 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 332/656] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:14 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:14.376733 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] validate_networks() for [('f40c29ea-3de1-4291-8b2e-116412f586de', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:32:14.433637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:14.434550 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:14.441062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:14.441846 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:14.442552 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:14.443502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:14.444286 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:14.445060 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:14.652700 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:14.661635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a5469fc4-4e72-4350-906d-8f307d4000e0 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.232793 Aug 09 11:32:14.662333 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 333/657] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:14 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:14.915243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:32:14.915659 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:32:14.916278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:32:14.916702 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:32:14.917093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:32:14.935455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:14.935953 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:14.936532 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:14.942724 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:14.943243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:14.943677 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:14.961705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:32:14.966517 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for user 8512df3e232c4fd59b7abad4e6e05c9d and project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:32:14.978581 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:32:14.981114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:32:15.036081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [f6658294-03e8-4bda-9f0f-8e7ba8371978] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 11:32:15.360151 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:15.360843 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:15.367335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:15.367848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:15.368274 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:15.369185 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:15.369632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:15.370047 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:15.517284 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:15.525825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1cb4f929-9b06-4d63-b71d-aaedd0dee151 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.169508 Aug 09 11:32:15.526720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 334/658] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:15 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:15.686528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:15.687575 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:15.695178 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:15.695676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:15.696106 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:15.696813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:15.697328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:15.697709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:15.840258 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:15.849059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d93521c2-1ef3-48a2-9167-094811e7fba6 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.168931 Aug 09 11:32:15.849598 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 335/659] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:15 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:16.045765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [f6658294-03e8-4bda-9f0f-8e7ba8371978] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 47340. Aug 09 11:32:16.060509 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6bf5b1bd-af59-45c2-b002-3ade858ce12a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.845156 Aug 09 11:32:16.067682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 325/660] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:32:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:32:16.073228 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6cba8c63-1842-4ce1-9cf1-bf4374f5715e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:16.073705 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6cba8c63-1842-4ce1-9cf1-bf4374f5715e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:16.095584 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:16.157616 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6cba8c63-1842-4ce1-9cf1-bf4374f5715e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:16.167264 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6cba8c63-1842-4ce1-9cf1-bf4374f5715e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1241 microversion: 2.1 time: 0.097854 Aug 09 11:32:16.179408 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 336/661] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:16 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:16.548160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:16.549181 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:16.555528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:16.556005 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:16.556464 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:16.557159 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:16.557606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:16.558021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:16.709328 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:16.717760 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e6e75f21-bbb8-4419-9f1c-12d6accbfdcc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.174444 Aug 09 11:32:16.718363 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 326/662] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:16 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:16.871175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:16.871800 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:16.878664 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:16.879425 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:16.880073 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:16.880787 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:16.881257 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:16.881673 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:17.023437 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:17.032057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2f514c37-9954-4a69-b8b9-41cfc7dcc196 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.164775 Aug 09 11:32:17.032905 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 337/663] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:16 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:17.188807 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:17.189436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:17.195390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:17.195863 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:17.196292 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:17.196972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:17.197404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:17.197835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:17.265153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:17.273982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-76e73896-1359-44f1-ac97-a50c81c15230 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1245 microversion: 2.1 time: 0.088924 Aug 09 11:32:17.274584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 327/664] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:17 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:17.739014 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:17.739632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:17.747359 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:17.747838 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:17.748262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:17.749113 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:17.749444 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:17.750028 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:17.909122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:17.918561 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2bf3abe7-af69-45cb-8832-3b1f906bb07d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.183640 Aug 09 11:32:17.919527 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 338/665] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:17 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:18.054242 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:18.055280 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:18.062769 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:18.063308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:18.063738 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:18.064434 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:18.064916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:18.065336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:18.237565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:18.248360 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d3606f37-6f1a-451d-9af0-161694012124 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.197863 Aug 09 11:32:18.249088 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 328/666] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:18 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:18.294843 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:18.295482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:18.301611 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:18.302105 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:18.302536 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:18.303260 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:18.303707 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:18.304139 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:18.367952 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:18.375669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4edd58b9-9179-4360-9201-8bc6b2ffc6ac tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1245 microversion: 2.1 time: 0.084906 Aug 09 11:32:18.376236 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 339/667] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:18 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:18.941024 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:18.942197 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:18.949328 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:18.949963 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:18.950502 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:18.951231 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:18.951678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:18.952123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:19.094974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:19.105091 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bb5b39e1-28fe-44e2-83b9-12ccc9e57c61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.168126 Aug 09 11:32:19.113061 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 329/668] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:18 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:19.269924 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:19.270549 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:19.277227 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:19.277807 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:19.278241 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:19.278958 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:19.279407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:19.279826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:19.396439 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:19.397050 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:19.404436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:19.405253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:19.405837 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:19.406784 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:19.407399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:19.408631 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:19.414013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:19.422503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d538a1ee-a034-4bfa-8f92-f8a7a5ddcd89 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.156502 Aug 09 11:32:19.423157 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 340/669] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:19 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:19.473023 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:19.483692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2e789e64-3c24-4f61-83d5-11e634d4a8e6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1245 microversion: 2.1 time: 0.090619 Aug 09 11:32:19.484300 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 330/670] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:19 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:20.129080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:20.130221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:20.140254 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:20.140836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:20.141337 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:20.142108 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:20.142627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:20.143074 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:20.286271 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:20.294042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3811496b-ee45-4edf-af0f-26f97e856654 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.171971 Aug 09 11:32:20.294610 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 341/671] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:20 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:20.445686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:20.446345 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:20.450009 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:20.454240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:20.454732 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:20.455214 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:20.455906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:20.456364 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:20.456783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:20.507785 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:20.508422 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:20.516002 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:20.516344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:20.516807 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:20.517522 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:20.518003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:20.518462 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:20.586248 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:20.594488 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-59846522-69c8-4f6e-8836-02579df98b4a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1245 microversion: 2.1 time: 0.090665 Aug 09 11:32:20.595324 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 342/672] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:20 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:20.621992 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:20.630238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a37be9b4-6938-4b76-aa0a-a3e74d60e8aa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.188383 Aug 09 11:32:20.630806 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 331/673] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:20 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:21.315655 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:21.316257 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:21.325053 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:21.325542 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:21.325964 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:21.326699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:21.327189 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:21.327614 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:21.472702 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:21.482289 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e19cdac1-f353-49a7-a776-bfc7a83a321b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.170455 Aug 09 11:32:21.482939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 343/674] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:21 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:21.616782 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:21.617716 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:21.624396 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:21.624858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:21.625325 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:21.625969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:21.626463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:21.626899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:21.652248 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:21.653009 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:21.655931 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:21.659797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:21.660289 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:21.660720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:21.661421 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:21.661875 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:21.662295 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:21.692595 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:21.703265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-769858e3-aaf8-43e9-9be7-8f1db8e56b72 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1245 microversion: 2.1 time: 0.091103 Aug 09 11:32:21.704686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 332/675] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:21 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:21.797947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:21.807277 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-31ba81e1-4a8d-4a59-96ac-0b88227591be tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.158798 Aug 09 11:32:21.807825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 344/676] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:21 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:22.504291 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:22.504896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:22.511382 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:22.511866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:22.512298 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:22.512983 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:22.513430 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:22.513846 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:22.647988 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:22.655939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-55c4a621-e855-4848-a017-2dc1c08e94c8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.155571 Aug 09 11:32:22.656513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 333/677] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:22 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:22.725746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:22.726383 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:22.733446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:22.733968 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:22.734379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:22.735139 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:22.735572 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:22.735993 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:22.799983 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:22.807896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ed1205df-5408-4dbd-bdb2-a479a3b251a5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1245 microversion: 2.1 time: 0.086035 Aug 09 11:32:22.808455 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 345/678] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:22 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:22.836515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:22.837162 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:22.844150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:22.844638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:22.845067 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:22.845774 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:22.846231 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:22.846654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:22.991654 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:23.001219 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5d9aac7a-8de1-4fe4-93a1-2b154a74bfaa tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.168707 Aug 09 11:32:23.001766 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 334/679] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:22 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:23.677265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:23.677779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:23.684107 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:23.684596 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:23.685051 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:23.685723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:23.686272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:23.686730 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:23.827391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:23.829754 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:23.830399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:23.837531 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5b596626-956f-47b3-8d19-22a06cbdfff6 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.163694 Aug 09 11:32:23.838632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 346/680] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:23 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:23.840327 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:23.841003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:23.841720 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:23.842881 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:23.843346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:23.843772 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:23.915452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:23.923633 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0c680800-71e2-4707-9539-f6a478894d0e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1245 microversion: 2.1 time: 0.097866 Aug 09 11:32:23.924192 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 335/681] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:23 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:24.022042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:24.022549 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:24.030866 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:24.031424 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:24.031870 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:24.032579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:24.033038 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:24.033464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:24.175737 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:24.185421 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8da139ac-62f8-4ed8-8fc1-6be1d297240b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.167294 Aug 09 11:32:24.186113 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 347/682] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:24 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:24.860454 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:24.861137 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:24.868060 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:24.868550 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:24.868991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:24.869712 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:24.870188 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:24.870615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:24.944700 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:24.945352 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:24.950639 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:24.957528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:24.957528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:24.957835 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:24.958585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:24.959068 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:24.959502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:24.964262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:24.974656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=16 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:25.044304 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:25.052473 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:25.058534 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0073495e-0d39-484d-894c-6ef89387daa0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1245 microversion: 2.1 time: 0.117811 Aug 09 11:32:25.059236 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 348/683] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:24 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:25.060247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-60e1939e-9a51-4803-83d8-e732a4042553 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.203935 Aug 09 11:32:25.060820 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 336/684] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:24 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:25.207922 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:25.208536 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:25.216387 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:25.216979 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:25.217541 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:25.218401 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:25.218978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:25.219503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:25.371062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:25.379631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6522f392-f38b-44b3-bb06-6e5e1e94931a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.176047 Aug 09 11:32:25.380220 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 349/685] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:25 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:25.469103 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-06a03992-eabd-4aca-9584-836b01521598 req-64a75655-028c-4d77-9bf4-63364be13052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8314a6fc-34c4-4aa1-9157-0ecf77cb217d", "tag": "9ffb71be-7afd-4c7c-a416-58412ef62e56"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:25.480132 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-06a03992-eabd-4aca-9584-836b01521598 req-64a75655-028c-4d77-9bf4-63364be13052 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:25.480921 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-06a03992-eabd-4aca-9584-836b01521598 req-64a75655-028c-4d77-9bf4-63364be13052 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:25.481519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-06a03992-eabd-4aca-9584-836b01521598 req-64a75655-028c-4d77-9bf4-63364be13052 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:25.495816 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-06a03992-eabd-4aca-9584-836b01521598 req-64a75655-028c-4d77-9bf4-63364be13052 service nova] Creating event network-changed:9ffb71be-7afd-4c7c-a416-58412ef62e56 for instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d on hv-cinder-84989 Aug 09 11:32:25.501500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-06a03992-eabd-4aca-9584-836b01521598 req-64a75655-028c-4d77-9bf4-63364be13052 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037640 Aug 09 11:32:25.502085 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 337/686] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:26.080796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:26.081500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:26.081698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:26.082474 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:26.088902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:26.089291 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:26.089515 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:26.089916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:26.090225 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:26.090488 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:26.091111 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:26.091368 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:26.091694 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:26.092008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:26.092230 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:26.092607 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:26.167005 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:26.169648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=14 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:26.177637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8d32b4f7-c1e0-40ea-8e59-1c53556c1872 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1299 microversion: 2.1 time: 0.100927 Aug 09 11:32:26.178439 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 350/687] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:26 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:26.257134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:26.265416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e391c8f5-35e0-4e85-a440-7d635f691428 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.188492 Aug 09 11:32:26.266005 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 338/688] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:26 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:26.402991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:26.403612 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:26.409781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:26.410270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:26.410700 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:26.411430 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:26.411900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:26.412341 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:26.552244 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:26.560527 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bc399820-b0fe-4816-8e6a-b1db0124f481 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.161821 Aug 09 11:32:26.561142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 351/689] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:26 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:27.199337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:27.199946 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:27.206751 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:27.207274 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:27.207708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:27.208408 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:27.208860 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:27.209259 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:27.285857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:27.286563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:27.293655 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:27.294225 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:27.294730 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:27.295611 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:27.296071 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:27.296497 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:27.381534 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:27.389562 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3d458950-d0e3-401d-a370-4b47206e91da tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.193971 Aug 09 11:32:27.390178 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 339/690] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:27 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:27.447407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:27.459108 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aa98bb9b-9ce3-4d7f-8fef-3df124990f61 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.176775 Aug 09 11:32:27.459907 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 352/691] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:27 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:27.582869 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:27.583501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:27.590430 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:27.590916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:27.591418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:27.592044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:27.592630 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:27.593059 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:27.734224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:27.742839 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-559b2046-d387-43e7-925c-00a4ad8c3604 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.164098 Aug 09 11:32:27.743457 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 340/692] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:27 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:28.409904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:28.410508 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:28.417542 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:28.418052 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:28.418479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:28.419221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:28.419691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:28.420084 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:28.484553 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:28.485436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:28.497637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:28.498972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:28.500970 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:28.502580 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:28.504029 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:28.504990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:28.594665 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:28.602577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d846ec29-37eb-4e14-85dd-9a953c693cc1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.196467 Aug 09 11:32:28.603164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 353/693] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:28 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:28.665649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:28.675255 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5ecc90a4-5d78-4d24-a211-b97f9533c81b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.197046 Aug 09 11:32:28.675844 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 341/694] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:28 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:28.765086 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:28.765681 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:28.772178 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:28.772678 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:28.773119 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:28.773814 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:28.774270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:28.774691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:28.913430 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:28.921763 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f2763589-87ff-4336-8055-bf506a25190d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.160763 Aug 09 11:32:28.922626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 354/695] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:28 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:29.623889 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:29.624605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:29.632073 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:29.632708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:29.633167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:29.633865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:29.634302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:29.634717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:29.639331 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:29.697103 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:29.697825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:29.706848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:29.708212 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:29.708737 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:29.709540 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:29.710142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:29.710634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:29.828592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:29.840750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1ddf362a-7600-4a4c-b5ad-0ad5dc7c46b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.220114 Aug 09 11:32:29.840750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 342/696] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:29 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:29.858978 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-af081ac4-dd6f-4d35-b172-55cc1476997d req-f5ae9a00-fa49-4f5f-96ad-7779e55dd509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8788b6bb-2936-4358-9a4d-6322062d8708", "tag": "cf3dce9c-970d-4a23-9d99-02b2d7c18e0a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:29.870166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-af081ac4-dd6f-4d35-b172-55cc1476997d req-f5ae9a00-fa49-4f5f-96ad-7779e55dd509 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:29.870656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-af081ac4-dd6f-4d35-b172-55cc1476997d req-f5ae9a00-fa49-4f5f-96ad-7779e55dd509 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:29.871123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-af081ac4-dd6f-4d35-b172-55cc1476997d req-f5ae9a00-fa49-4f5f-96ad-7779e55dd509 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:29.882625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-af081ac4-dd6f-4d35-b172-55cc1476997d req-f5ae9a00-fa49-4f5f-96ad-7779e55dd509 service nova] Creating event network-changed:cf3dce9c-970d-4a23-9d99-02b2d7c18e0a for instance 8788b6bb-2936-4358-9a4d-6322062d8708 on hv-cinder-84989 Aug 09 11:32:29.888958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-af081ac4-dd6f-4d35-b172-55cc1476997d req-f5ae9a00-fa49-4f5f-96ad-7779e55dd509 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036316 Aug 09 11:32:29.890371 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 343/697] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:29.899007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:29.906920 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3f9e524b-ba6a-43ad-a961-4ce169396fbf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.214516 Aug 09 11:32:29.907491 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 355/698] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:29 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:29.944176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:29.945038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:29.951950 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:29.952400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:29.952828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:29.953521 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:29.953959 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:29.954371 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:30.096352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:30.104959 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d07a9ea5-87c6-457e-8bda-5464eff76036 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.164873 Aug 09 11:32:30.105940 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 344/699] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:29 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:30.865406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:30.866035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:30.873160 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:30.873640 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:30.874065 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:30.874753 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:30.875229 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:30.875645 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:30.930671 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:30.931529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:30.938239 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:30.938901 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:30.939437 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:30.940240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:30.940976 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:30.941493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:31.065440 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:31.074518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ff52e4d7-feca-4592-aa69-8be10c0f0ddb tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.213050 Aug 09 11:32:31.080423 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 356/700] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:30 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:31.114697 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:31.122596 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-577e83a7-f784-438b-8d3e-8bfe1a2568dc tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.196073 Aug 09 11:32:31.123114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 345/701] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:30 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:31.125635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:31.126239 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:31.132451 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:31.132945 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:31.133373 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:31.134121 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:31.134605 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:31.135059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:31.282966 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:31.291501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8b316761-fbd9-463b-b797-127178d5f695 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.169798 Aug 09 11:32:31.292116 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 357/702] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:31 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:32.096636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:32.097262 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:32.104174 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:32.104663 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:32.105101 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:32.105785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:32.106246 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:32.106664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:32.143352 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:32.143963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:32.150926 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:32.151417 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:32.151851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:32.152542 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:32.153003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:32.153432 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:32.288408 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:32.298324 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-37353d44-37be-4f4c-ba35-033d5ec0842f tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.205641 Aug 09 11:32:32.299332 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 346/703] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:32 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:32.313730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:32.314354 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:32.317315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:32.320651 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:32.321140 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:32.321542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:32.322243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:32.322690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:32.323140 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:32.325044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-85f5d127-c6a1-4e97-8554-8bdf60bd8eba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.185527 Aug 09 11:32:32.326874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 358/704] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:32 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:32.462662 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:32.471665 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ffb30e51-983e-4a87-ae6d-5278fb1c9aef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.162304 Aug 09 11:32:32.472315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 347/705] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:32 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:32.521234 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-a67c1178-4710-4332-8340-94eb7ace9827 req-7b5a22ab-015d-4387-987e-26b4f2f08872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8314a6fc-34c4-4aa1-9157-0ecf77cb217d", "name": "network-vif-plugged", "status": "completed", "tag": "9ffb71be-7afd-4c7c-a416-58412ef62e56"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:32.531488 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a67c1178-4710-4332-8340-94eb7ace9827 req-7b5a22ab-015d-4387-987e-26b4f2f08872 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:32.531976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a67c1178-4710-4332-8340-94eb7ace9827 req-7b5a22ab-015d-4387-987e-26b4f2f08872 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:32.532555 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a67c1178-4710-4332-8340-94eb7ace9827 req-7b5a22ab-015d-4387-987e-26b4f2f08872 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:32.547978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-a67c1178-4710-4332-8340-94eb7ace9827 req-7b5a22ab-015d-4387-987e-26b4f2f08872 service nova] Creating event network-vif-plugged:9ffb71be-7afd-4c7c-a416-58412ef62e56 for instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d on hv-cinder-84989 Aug 09 11:32:32.554294 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-a67c1178-4710-4332-8340-94eb7ace9827 req-7b5a22ab-015d-4387-987e-26b4f2f08872 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103592 Aug 09 11:32:32.555001 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 359/706] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:32:33.320684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:33.321247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:33.328351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:33.328828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:33.329261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:33.329961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:33.330410 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:33.330930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:33.349082 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:33.349775 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:33.356243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:33.356724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:33.357167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:33.357868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:33.358330 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:33.358751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:33.530319 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:33.538920 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2669f545-94a8-4123-bba2-1ccd1add7acf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.222994 Aug 09 11:32:33.540220 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 348/707] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:33 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:33.542203 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:33.544830 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:33.545969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:33.550085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-49b5168c-aae5-45eb-a3f4-a1cc3a609476 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.206200 Aug 09 11:32:33.550641 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 360/708] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:33 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:33.551687 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:33.552221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:33.552655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:33.553384 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:33.553868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:33.554290 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:33.690346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:33.704239 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b719d0b3-be93-4e9b-91ed-9dabc6cca07f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.162513 Aug 09 11:32:33.705520 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 349/709] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:33 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:34.560839 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:34.561520 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:34.568955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:34.569469 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:34.569898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:34.570592 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:34.570730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:34.571188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:34.571347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:34.571512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:34.578128 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:34.578617 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:34.579093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:34.579800 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:34.580243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:34.580668 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:34.774432 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:34.783085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-80755a2f-b2d9-4527-ad32-8ba9cf63e39b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.226253 Aug 09 11:32:34.783554 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:34.784422 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 361/710] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:34 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:34.790450 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:34.791103 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:34.797318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:34.797778 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:34.798403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:34.799316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:34.799930 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:34.800510 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:34.807596 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f200d031-24bd-4310-8ea6-a5b22b693135 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.240754 Aug 09 11:32:34.809035 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 350/711] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:34 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:34.933049 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:34.941826 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-002e28d9-cf1d-4a40-a439-89bc0b9f8665 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.156001 Aug 09 11:32:34.942454 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 362/712] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:34 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:35.804651 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:35.805229 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:35.812500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:35.812895 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:35.814018 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:35.814018 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:35.814457 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:35.814884 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:35.829805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:35.830382 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:35.837411 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:35.837921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:35.838358 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:35.839100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:35.839553 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:35.840035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:35.999836 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:36.007951 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1b555b93-4707-48c0-bfdd-d793a1399dc0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.207514 Aug 09 11:32:36.008533 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 351/713] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:35 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:36.013166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:36.013780 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:36.019747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:36.020438 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:36.021093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:36.021798 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:36.022252 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:36.022676 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:36.034377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:36.042293 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a65241fe-ba48-4624-9b22-f45beb6b379b tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.216377 Aug 09 11:32:36.042847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 363/714] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:35 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:36.158243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:36.167481 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0e645f1b-2784-4316-af8c-058063fa342d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1733 microversion: 2.1 time: 0.157865 Aug 09 11:32:36.168275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 352/715] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:36 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:36.451315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-2e16a917-6c8f-47fa-9750-fac7271a4e34 req-6f8b3a45-80c1-48b7-89f3-090efd3317d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8788b6bb-2936-4358-9a4d-6322062d8708", "name": "network-vif-plugged", "status": "completed", "tag": "cf3dce9c-970d-4a23-9d99-02b2d7c18e0a"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:36.461566 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2e16a917-6c8f-47fa-9750-fac7271a4e34 req-6f8b3a45-80c1-48b7-89f3-090efd3317d6 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:36.462480 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2e16a917-6c8f-47fa-9750-fac7271a4e34 req-6f8b3a45-80c1-48b7-89f3-090efd3317d6 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:36.462939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-2e16a917-6c8f-47fa-9750-fac7271a4e34 req-6f8b3a45-80c1-48b7-89f3-090efd3317d6 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:36.475469 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-2e16a917-6c8f-47fa-9750-fac7271a4e34 req-6f8b3a45-80c1-48b7-89f3-090efd3317d6 service nova] Creating event network-vif-plugged:cf3dce9c-970d-4a23-9d99-02b2d7c18e0a for instance 8788b6bb-2936-4358-9a4d-6322062d8708 on hv-cinder-84989 Aug 09 11:32:36.487659 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-2e16a917-6c8f-47fa-9750-fac7271a4e34 req-6f8b3a45-80c1-48b7-89f3-090efd3317d6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039989 Aug 09 11:32:36.488555 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 364/716] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:37.028464 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:37.029063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:37.036024 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.036520 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.036947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.037633 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.038083 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.038500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.063970 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:37.064658 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:37.073152 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.073655 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.074102 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.074820 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.075323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.075751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.230630 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:37.240242 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b96fc9e7-e2d8-4068-91cd-c301a5b2c7c2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.215610 Aug 09 11:32:37.242405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 353/717] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:37 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:37.248781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:37.249504 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:37.257888 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.258436 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:37.258771 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.259646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.260655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.262191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.262900 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.267795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c23954c8-b387-4206-88a3-16c909373e21 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1359 microversion: 2.1 time: 0.209143 Aug 09 11:32:37.268777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 365/718] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:37 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:37.438890 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:37.448031 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ab14d8dc-84db-4650-92fa-8503f16aa8da tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1713 microversion: 2.1 time: 0.203976 Aug 09 11:32:37.448616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 354/719] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:37 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1713 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:37.526841 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:37.527645 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:37.536937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.537721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.538157 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.538864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.539337 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.539754 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.543802 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:37.633732 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] HTTP exception thrown: Cannot 'detach_volume' instance 8c922f63-17a0-4421-bd4d-7a4430540a29 while it is in vm_state rescued Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Request method failure captured: Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments/69fc5377-37d0-46d4-afeb-140a87001870 HTTP/1.1 Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRG0rpW3sj4nheZdhbCxPm1Z5jfdUcOxP527qQ7_jhokZykFQKs4TqP5xopsG9oPMsNJkr1PNRrC0MRk4UMMaYA88FH_DuQHQWbKZ_AZE6sayLLRgjaZLDJoymwC7JncPc5njCMgeqjV2Sb9VT0FTc_qt5jZ6gsr1fDQYvwfbnyN-o Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:32:37.635501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b0a6fd5299a7475bad7836d22b23967d", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8f9dc600fea34effa2afa8aee54aab7e Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:32:37.637323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Cannot 'detach_volume' instance 8c922f63-17a0-4421-bd4d-7a4430540a29 while it is in vm_state rescued Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'server_id': '8c922f63-17a0-4421-bd4d-7a4430540a29', 'id': '69fc5377-37d0-46d4-afeb-140a87001870'} Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8c922f63-17a0-4421-bd4d-7a4430540a29 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:32:37.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8c922f63-17a0-4421-bd4d-7a4430540a29 while it is in vm_state rescued Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8c922f63-17a0-4421-bd4d-7a4430540a29 while it is in vm_state rescued Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:32:37.641457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Returning 409 to user: Cannot 'detach_volume' instance 8c922f63-17a0-4421-bd4d-7a4430540a29 while it is in vm_state rescued {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:32:37.643626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-69cd8a28-b361-4ff2-b6de-a2e78a629a8d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments/69fc5377-37d0-46d4-afeb-140a87001870" status: 409 len: 152 microversion: 2.1 time: 0.116564 Aug 09 11:32:37.643626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 366/720] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:32:37 2022] DELETE /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments/69fc5377-37d0-46d4-afeb-140a87001870 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 11:32:37.650200 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0b14609c-b505-4dd5-aa64-ea40d9b0bd10 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:37.650880 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0b14609c-b505-4dd5-aa64-ea40d9b0bd10 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:37.659756 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b14609c-b505-4dd5-aa64-ea40d9b0bd10 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.660486 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b14609c-b505-4dd5-aa64-ea40d9b0bd10 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.661010 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b14609c-b505-4dd5-aa64-ea40d9b0bd10 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.662008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b14609c-b505-4dd5-aa64-ea40d9b0bd10 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.662739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b14609c-b505-4dd5-aa64-ea40d9b0bd10 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.663198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0b14609c-b505-4dd5-aa64-ea40d9b0bd10 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.737560 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0b14609c-b505-4dd5-aa64-ea40d9b0bd10 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "POST /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/action" status: 202 len: 0 microversion: 2.1 time: 0.093222 Aug 09 11:32:37.738192 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 355/721] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:32:37 2022] POST /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:32:37.748147 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:37.748761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:37.755781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.756322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.756796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.757761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:37.758278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:37.758705 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:37.899561 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:37.908578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0bbf4ef7-ff2b-4fa7-8b0a-c7ea66d03ea2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1721 microversion: 2.1 time: 0.164086 Aug 09 11:32:37.909169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 367/722] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:37 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:38.263463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:38.264203 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:38.271873 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.272436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.273053 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.274041 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.274581 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.275374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.295024 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:38.295603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:38.302346 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.303189 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.303628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.304332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.304789 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.305199 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.581984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:38.590311 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ab169aab-e1f8-4e2c-81e3-ffbf8f215664 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1367 microversion: 2.1 time: 0.331524 Aug 09 11:32:38.590933 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 356/723] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:38 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:38.611425 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:38.619292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-14802b28-f9cb-44c2-b40a-a3d168b520ae tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1549 microversion: 2.1 time: 0.328271 Aug 09 11:32:38.619861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 368/724] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:38 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1549 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:38.640409 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:38.641014 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:38.647227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.647712 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.648139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.648840 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.649290 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.649712 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.801264 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:38.809904 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-13917f14-a8f7-4aba-838b-0aeb7626a350 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1549 microversion: 2.1 time: 0.173567 Aug 09 11:32:38.810456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 357/725] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:38 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:38.832158 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:38.837472 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:38.838270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Searching by: {'deleted': False, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478'} {{(pid=117793) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 11:32:38.845582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.846067 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.846506 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.847265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.847745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.848155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.930203 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:38.931584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:38.937855 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.938344 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.938770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.939594 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:38.940041 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:38.940458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:38.943119 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.multi_cell_list [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 11:32:38.960583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:39.040716 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-28c378b7-c6bd-4df5-8543-253b99472f60 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212960 Aug 09 11:32:39.041301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 369/726] 10.222.0.59 () {58 vars in 1125 bytes} [Tue Aug 9 11:32:38 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:39.052634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:39.053407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:39.059421 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:39.059898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:39.060315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:39.061006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:39.061451 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:39.061864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:39.238571 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:39.247792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9893fb9d-30c0-4d9a-9180-4bc00c8b54c9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1721 microversion: 2.1 time: 0.321571 Aug 09 11:32:39.248732 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 358/727] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:38 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:39.312867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:39.321555 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9f9716fc-0628-416f-b7a9-f9ae7a4ca003 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1549 microversion: 2.1 time: 0.272779 Aug 09 11:32:39.322141 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 370/728] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:39 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1549 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:39.612238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:39.613068 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:39.619730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:39.620212 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:39.620631 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:39.621325 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:39.621769 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:39.622179 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:39.791797 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:39.802934 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0d700ecd-6f04-4994-b186-88a70985f6e5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1557 microversion: 2.1 time: 0.194533 Aug 09 11:32:39.803844 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 359/729] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:39 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:32:39.828928 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d690c099-c09a-4c61-a5bc-47c9fa2ba8b1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:39.829425 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d690c099-c09a-4c61-a5bc-47c9fa2ba8b1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:39.835952 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d690c099-c09a-4c61-a5bc-47c9fa2ba8b1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:39.836426 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d690c099-c09a-4c61-a5bc-47c9fa2ba8b1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:39.837253 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d690c099-c09a-4c61-a5bc-47c9fa2ba8b1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:39.837953 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d690c099-c09a-4c61-a5bc-47c9fa2ba8b1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:39.838406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d690c099-c09a-4c61-a5bc-47c9fa2ba8b1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:39.838849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d690c099-c09a-4c61-a5bc-47c9fa2ba8b1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:39.918396 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d690c099-c09a-4c61-a5bc-47c9fa2ba8b1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093420 Aug 09 11:32:39.919037 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 371/730] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 11:32:39 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:40.271067 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:40.271600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:40.278489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:40.279044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:40.279740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:40.280478 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:40.280939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:40.281370 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:40.587641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:40.595989 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3795c6ae-671b-4a4a-b0ce-91d5b5a3cea9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1721 microversion: 2.1 time: 0.329672 Aug 09 11:32:40.596776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 360/731] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:40 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1721 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:40.990561 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2e65d5dd-368e-4f8b-9e07-9f9c2e79d599 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:40.994316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2e65d5dd-368e-4f8b-9e07-9f9c2e79d599 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:41.002491 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e65d5dd-368e-4f8b-9e07-9f9c2e79d599 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:41.003551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e65d5dd-368e-4f8b-9e07-9f9c2e79d599 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:41.004548 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e65d5dd-368e-4f8b-9e07-9f9c2e79d599 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:41.004954 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e65d5dd-368e-4f8b-9e07-9f9c2e79d599 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:41.005484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e65d5dd-368e-4f8b-9e07-9f9c2e79d599 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:41.005936 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e65d5dd-368e-4f8b-9e07-9f9c2e79d599 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:41.416931 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-fc2acdaf-6f23-48e5-9eed-66b049696862 req-ef61035a-bb3a-486e-b76f-d0f6f2cab365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8788b6bb-2936-4358-9a4d-6322062d8708", "tag": "cf3dce9c-970d-4a23-9d99-02b2d7c18e0a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:41.427270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-fc2acdaf-6f23-48e5-9eed-66b049696862 req-ef61035a-bb3a-486e-b76f-d0f6f2cab365 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:41.427752 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-fc2acdaf-6f23-48e5-9eed-66b049696862 req-ef61035a-bb3a-486e-b76f-d0f6f2cab365 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:41.428183 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-fc2acdaf-6f23-48e5-9eed-66b049696862 req-ef61035a-bb3a-486e-b76f-d0f6f2cab365 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:41.441107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-fc2acdaf-6f23-48e5-9eed-66b049696862 req-ef61035a-bb3a-486e-b76f-d0f6f2cab365 service nova] Creating event network-changed:cf3dce9c-970d-4a23-9d99-02b2d7c18e0a for instance 8788b6bb-2936-4358-9a4d-6322062d8708 on hv-cinder-84989 Aug 09 11:32:41.446726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-fc2acdaf-6f23-48e5-9eed-66b049696862 req-ef61035a-bb3a-486e-b76f-d0f6f2cab365 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094612 Aug 09 11:32:41.447708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 361/732] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:41.618432 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:41.619158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:41.625588 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:41.626073 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:41.626501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:41.627229 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:41.627675 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:41.628094 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:41.762404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:41.770664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c2585d6f-9fe2-4875-97d9-6a1d27e18b72 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1721 microversion: 2.1 time: 0.156639 Aug 09 11:32:41.771546 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 362/733] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:41 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:42.792857 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:42.793529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:42.800346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:42.800828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:42.801262 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:42.801928 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:42.802402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:42.802859 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:42.941418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:42.950912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-46872a8a-8712-4a59-b486-e01025bc0f4f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1721 microversion: 2.1 time: 0.162024 Aug 09 11:32:42.951480 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 363/734] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:42 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:43.271362 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2e65d5dd-368e-4f8b-9e07-9f9c2e79d599 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "POST /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.288334 Aug 09 11:32:43.272087 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 372/735] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:32:40 2022] POST /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments => generated 194 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:43.973350 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:43.974744 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:43.981870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:43.982325 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:43.982740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:43.983486 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:43.983940 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:43.984363 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:44.195113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:44.203801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-80cb581e-18ba-4db7-a4f0-55589f01ed44 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1727 microversion: 2.1 time: 0.234540 Aug 09 11:32:44.204543 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 364/736] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:43 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1727 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:44.226751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ba7362e9-4d74-4dc4-9b28-617de634766d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:44.227445 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ba7362e9-4d74-4dc4-9b28-617de634766d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:44.234017 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba7362e9-4d74-4dc4-9b28-617de634766d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:44.234511 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba7362e9-4d74-4dc4-9b28-617de634766d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:44.235088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba7362e9-4d74-4dc4-9b28-617de634766d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:44.235764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba7362e9-4d74-4dc4-9b28-617de634766d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:44.236238 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba7362e9-4d74-4dc4-9b28-617de634766d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:44.236662 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba7362e9-4d74-4dc4-9b28-617de634766d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:44.322401 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ba7362e9-4d74-4dc4-9b28-617de634766d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100567 Aug 09 11:32:44.323116 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 373/737] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 11:32:44 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:45.252036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-7cfa30b9-5eac-470a-a3ff-645d26da4a83 req-bf505a12-4280-4adf-82ca-a97055609f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c922f63-17a0-4421-bd4d-7a4430540a29", "tag": "d007e409-d8a8-4797-bfb3-ed337e9631c6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:45.264694 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7cfa30b9-5eac-470a-a3ff-645d26da4a83 req-bf505a12-4280-4adf-82ca-a97055609f71 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:45.264694 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7cfa30b9-5eac-470a-a3ff-645d26da4a83 req-bf505a12-4280-4adf-82ca-a97055609f71 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:45.264694 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-7cfa30b9-5eac-470a-a3ff-645d26da4a83 req-bf505a12-4280-4adf-82ca-a97055609f71 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:45.277138 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-7cfa30b9-5eac-470a-a3ff-645d26da4a83 req-bf505a12-4280-4adf-82ca-a97055609f71 service nova] Creating event network-changed:d007e409-d8a8-4797-bfb3-ed337e9631c6 for instance 8c922f63-17a0-4421-bd4d-7a4430540a29 on hv-cinder-84989 Aug 09 11:32:45.282257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-7cfa30b9-5eac-470a-a3ff-645d26da4a83 req-bf505a12-4280-4adf-82ca-a97055609f71 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033888 Aug 09 11:32:45.282916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 365/738] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:45.462767 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:45.463851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:45.470849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:45.472447 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:45.473058 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:45.474044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:45.474490 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:45.475091 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:45.581585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lazy-loading 'services' on Instance uuid 26bbe60e-21bf-4703-8873-5190575e1ec9 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:32:45.682867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7f17307e-bf49-44f4-9c28-ffb377fe0617 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/os-volume_attachments/cfa36a9a-e2d0-4657-986a-3b44a5129708" status: 202 len: 0 microversion: 2.1 time: 0.346133 Aug 09 11:32:45.683353 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 374/739] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:32:45 2022] DELETE /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/os-volume_attachments/cfa36a9a-e2d0-4657-986a-3b44a5129708 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:32:47.300558 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-e1d3f240-f17e-42fe-a727-eea9dc13d73b req-ed5455cd-a95a-4775-a0bd-c729f34822c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c922f63-17a0-4421-bd4d-7a4430540a29", "tag": "d007e409-d8a8-4797-bfb3-ed337e9631c6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:47.310971 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-e1d3f240-f17e-42fe-a727-eea9dc13d73b req-ed5455cd-a95a-4775-a0bd-c729f34822c0 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:47.311367 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-e1d3f240-f17e-42fe-a727-eea9dc13d73b req-ed5455cd-a95a-4775-a0bd-c729f34822c0 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:47.311807 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-e1d3f240-f17e-42fe-a727-eea9dc13d73b req-ed5455cd-a95a-4775-a0bd-c729f34822c0 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:47.324727 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-e1d3f240-f17e-42fe-a727-eea9dc13d73b req-ed5455cd-a95a-4775-a0bd-c729f34822c0 service nova] Creating event network-changed:d007e409-d8a8-4797-bfb3-ed337e9631c6 for instance 8c922f63-17a0-4421-bd4d-7a4430540a29 on hv-cinder-84989 Aug 09 11:32:47.329811 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-e1d3f240-f17e-42fe-a727-eea9dc13d73b req-ed5455cd-a95a-4775-a0bd-c729f34822c0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036361 Aug 09 11:32:47.330476 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 366/740] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:52.044249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:52.050277 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:52.051324 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:52.053992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=61 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:52.060453 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:52.060961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:52.061418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:52.062145 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:52.062599 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:52.063084 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:52.137783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d7d7d112-be6c-4c1c-ba75-53eae489fa68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:52.140687 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=71 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:52.146677 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d7d7d112-be6c-4c1c-ba75-53eae489fa68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:52.147213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d7d7d112-be6c-4c1c-ba75-53eae489fa68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:52.147643 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d7d7d112-be6c-4c1c-ba75-53eae489fa68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:52.174656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d7d7d112-be6c-4c1c-ba75-53eae489fa68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Going to try to stop instance {{(pid=117792) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 11:32:52.216018 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:52.224460 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-654d13fd-3b92-4c0e-ac2e-bf506860e3ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1595 microversion: 2.1 time: 0.182843 Aug 09 11:32:52.225316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 375/741] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:52 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1595 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:52.229200 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d7d7d112-be6c-4c1c-ba75-53eae489fa68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/action" status: 202 len: 0 microversion: 2.1 time: 0.096150 Aug 09 11:32:52.229882 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 367/742] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:32:52 2022] POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:32:52.244820 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:52.245446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:52.252077 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:52.252618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:52.253291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:52.254044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:52.254504 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:52.254943 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:52.507189 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:52.516387 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-43f502b5-a0a0-41f2-b814-95db09b75364 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.276133 Aug 09 11:32:52.517059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 376/743] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:52 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:53.541412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:53.542238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:53.550294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:53.550799 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:53.551260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:53.552002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:53.552443 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:53.552859 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:54.008151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:54.018101 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f630bfd6-13db-4a90-beea-e082462f2c9c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.481529 Aug 09 11:32:54.018788 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 368/744] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:53 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:54.398897 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-85dc26bb-b466-49d9-b3cc-0922420e90d7 req-f08e8878-0d2a-4f30-b40a-fad4cc98c354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8314a6fc-34c4-4aa1-9157-0ecf77cb217d", "tag": "9ffb71be-7afd-4c7c-a416-58412ef62e56"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:54.409216 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-85dc26bb-b466-49d9-b3cc-0922420e90d7 req-f08e8878-0d2a-4f30-b40a-fad4cc98c354 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:54.409697 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-85dc26bb-b466-49d9-b3cc-0922420e90d7 req-f08e8878-0d2a-4f30-b40a-fad4cc98c354 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:54.410125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-85dc26bb-b466-49d9-b3cc-0922420e90d7 req-f08e8878-0d2a-4f30-b40a-fad4cc98c354 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:54.423122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-85dc26bb-b466-49d9-b3cc-0922420e90d7 req-f08e8878-0d2a-4f30-b40a-fad4cc98c354 service nova] Creating event network-changed:9ffb71be-7afd-4c7c-a416-58412ef62e56 for instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d on hv-cinder-84989 Aug 09 11:32:54.428682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-85dc26bb-b466-49d9-b3cc-0922420e90d7 req-f08e8878-0d2a-4f30-b40a-fad4cc98c354 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033427 Aug 09 11:32:54.429528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 377/745] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:55.044543 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:55.045638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:55.054867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:55.055656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:55.056608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:55.057922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:55.058778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:55.059413 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:55.369467 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:55.379465 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-068bf10e-7c9e-46fd-a0c5-f81fc6793659 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.342457 Aug 09 11:32:55.380528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 369/746] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:55 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:55.753725 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-959065251"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:55.754352 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:55.761189 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:55.761674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:55.762106 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:55.762807 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:55.763271 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:55.763691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:55.895527 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.network.security_group_api [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Adding security group 6e427f2f-0b31-4a61-b457-c334fd03c48c to port 9ffb71be-7afd-4c7c-a416-58412ef62e56 Aug 09 11:32:56.276927 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-04974313-31c0-4399-ba27-9f99f8c75939 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "POST /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/action" status: 202 len: 0 microversion: 2.1 time: 0.527425 Aug 09 11:32:56.277780 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 378/747] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:32:55 2022] POST /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:32:56.286114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:56.286776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:56.294333 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:56.294333 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:56.294934 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:56.295694 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:56.296149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:56.296596 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:56.403853 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:56.404918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:56.412221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:56.412862 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:56.413790 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:56.414733 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:56.415502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:56.416011 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:56.502123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:56.510675 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9cf1cfbe-9f01-4d5f-a43f-09fa6a4370f7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1760 microversion: 2.1 time: 0.228605 Aug 09 11:32:56.511665 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 370/748] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:56 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1760 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:56.516871 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-dae24340-94eb-4b56-a477-3d50cc2e5739 req-3f780742-da39-463e-9162-345c29554bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8314a6fc-34c4-4aa1-9157-0ecf77cb217d", "tag": "9ffb71be-7afd-4c7c-a416-58412ef62e56"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:32:56.527907 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-dae24340-94eb-4b56-a477-3d50cc2e5739 req-3f780742-da39-463e-9162-345c29554bfe service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:56.528386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-dae24340-94eb-4b56-a477-3d50cc2e5739 req-3f780742-da39-463e-9162-345c29554bfe service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:56.528816 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-dae24340-94eb-4b56-a477-3d50cc2e5739 req-3f780742-da39-463e-9162-345c29554bfe service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:56.541364 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-dae24340-94eb-4b56-a477-3d50cc2e5739 req-3f780742-da39-463e-9162-345c29554bfe service nova] Creating event network-changed:9ffb71be-7afd-4c7c-a416-58412ef62e56 for instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d on hv-cinder-84989 Aug 09 11:32:56.546525 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-dae24340-94eb-4b56-a477-3d50cc2e5739 req-3f780742-da39-463e-9162-345c29554bfe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033607 Aug 09 11:32:56.547475 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 371/749] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:32:56.585775 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:56.594296 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7e31b771-3e1d-42ef-a515-dcf6b40e988f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.194982 Aug 09 11:32:56.594946 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 379/750] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:56 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:57.616904 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:57.617559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:57.624702 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:57.625217 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:57.625671 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:57.626386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:57.626855 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:57.627302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:57.766902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:57.774737 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-14234f3e-decf-4a8f-9722-ecaa5cc19128 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.162986 Aug 09 11:32:57.775343 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 372/751] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:57 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:58.797311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:58.797876 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:58.805084 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:58.805587 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:58.806125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:58.806839 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:58.807323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:58.807742 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:58.951128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:32:58.959245 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cc6baec6-d785-407a-a936-6377c8c3230b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.165886 Aug 09 11:32:58.959841 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 380/752] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:58 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:32:59.985662 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:32:59.987030 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:32:59.995047 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:59.995546 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:59.995983 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:32:59.996705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:32:59.997156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:32:59.997663 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:00.175041 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:00.183525 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f4e21e34-21c6-486a-9189-2aa02b8dcb95 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.204299 Aug 09 11:33:00.184116 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 373/753] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:32:59 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:01.205007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:01.205620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:01.213263 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:01.213791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:01.214208 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:01.215676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:01.215676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:01.215877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:01.458537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:01.471517 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6309fa5e-836c-4bec-8ea0-97f97c44a9c7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.270091 Aug 09 11:33:01.473836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 381/754] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:01 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:33:02.496478 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:02.497787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:02.505231 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:02.505716 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:02.506153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:02.506879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:02.507371 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:02.507806 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:02.648039 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:02.656465 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-44190274-3ae4-4738-83e4-68f1d5291d92 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.165137 Aug 09 11:33:02.657050 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 374/755] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:02 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:03.680888 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:03.681591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:03.690387 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:03.691039 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:03.691475 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:03.692178 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:03.692842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:03.693384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:03.710654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:03.852815 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:03.863949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6d57c8f3-616e-49d0-8fd8-48efb2f64d73 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.186358 Aug 09 11:33:03.864556 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 382/756] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:03 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:04.886421 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:04.887423 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:04.894766 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:04.895310 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:04.895740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:04.896501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:04.896958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:04.897381 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:05.065585 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:05.074639 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-42b8eb85-9953-46f6-9763-df0cac7ad189 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.192073 Aug 09 11:33:05.075294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 375/757] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:04 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:06.100780 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:06.101741 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:06.109069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:06.109709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:06.110236 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:06.111148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:06.111700 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:06.112214 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:06.259231 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:06.267714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a3bb46f9-cd9b-4581-855f-9d6646e3c9ba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.171703 Aug 09 11:33:06.268545 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 383/758] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:06 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:07.294877 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:07.295436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:07.302672 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:07.303203 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:07.303666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:07.304411 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:07.304887 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:07.305313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:07.454498 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:07.459547 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:07.465980 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4da627a0-a9ba-4c4d-80e0-ee01f821ebee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1678 microversion: 2.1 time: 0.175282 Aug 09 11:33:07.466627 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 376/759] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:07 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:08.488651 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:08.489264 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:08.496426 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:08.496908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:08.497334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:08.498040 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:08.498491 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:08.498946 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:08.642277 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:08.655869 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0f96b87e-a8a2-49de-a3a9-235aa24ac735 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1655 microversion: 2.1 time: 0.170896 Aug 09 11:33:08.656924 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 384/760] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:08 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1655 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:08.677463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5051de96-dd23-411d-a8fa-35c7ab96d6c8 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:33:08.685568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5051de96-dd23-411d-a8fa-35c7ab96d6c8 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:08.686096 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5051de96-dd23-411d-a8fa-35c7ab96d6c8 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:08.686525 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5051de96-dd23-411d-a8fa-35c7ab96d6c8 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:08.712455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5051de96-dd23-411d-a8fa-35c7ab96d6c8 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Going to try to start instance {{(pid=117792) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 11:33:08.764666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5051de96-dd23-411d-a8fa-35c7ab96d6c8 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/action" status: 202 len: 0 microversion: 2.1 time: 0.090951 Aug 09 11:33:08.765287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 377/761] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:33:08 2022] POST /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:33:08.776302 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:08.777364 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:08.786569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:08.787191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:08.787623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:08.788329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:08.788777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:08.789202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:09.010281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:09.018553 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bf955dad-49d1-4b8e-ba2d-ac43f132ee91 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1664 microversion: 2.1 time: 0.248354 Aug 09 11:33:09.030995 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 385/762] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:08 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1664 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:10.043755 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:10.044436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:10.051396 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:10.051903 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:10.052317 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:10.053013 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:10.053445 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:10.053860 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:10.214610 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:10.223685 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-071d7c0a-6d92-4061-bda9-64b6f87096ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1664 microversion: 2.1 time: 0.185865 Aug 09 11:33:10.224338 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 378/763] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:10 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1664 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:11.052708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:33:11.053273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:11.059949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:11.060484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:11.060894 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:11.061581 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:11.062008 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:11.062430 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:11.089884 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lazy-loading 'flavor' on Instance uuid dafb83be-fb97-4c38-9818-862de58903e2 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:33:11.166091 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2c22630a-bc31-44f8-86e7-8ecbd7d6f079 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "POST /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2/action" status: 202 len: 0 microversion: 2.1 time: 0.117226 Aug 09 11:33:11.166764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 386/764] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:33:11 2022] POST /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:33:11.175765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:11.176637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:11.183755 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:11.184236 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:11.184671 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:11.185367 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:11.185810 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:11.186251 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:11.246658 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:11.247433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:11.254729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:11.255252 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:11.255687 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:11.256388 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:11.256862 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:11.257290 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:11.371171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:11.379357 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3c9a824e-2c7e-454f-9ed9-2cc4a0f36081 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.207773 Aug 09 11:33:11.379941 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 379/765] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:11 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:11.419802 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:11.427681 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cd84a67d-a1ee-4cb6-8598-0a11f0fa3722 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1668 microversion: 2.1 time: 0.185578 Aug 09 11:33:11.428259 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 387/766] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:11 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1668 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:12.404911 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:12.405548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:12.412667 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:12.413157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:12.413586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:12.414291 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:12.414742 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:12.415195 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:12.561855 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:12.571311 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f3ebf009-86e9-4302-80d0-9b426872532e tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.170146 Aug 09 11:33:12.571905 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 380/767] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:12 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:13.593557 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:13.594146 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:13.601041 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:13.601525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:13.601956 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:13.602647 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:13.603128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:13.603675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:14.008398 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:14.017829 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b2975465-72be-459b-aee8-d8c317b601de tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.428176 Aug 09 11:33:14.018659 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 388/768] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:13 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:15.040843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:15.041483 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:15.048034 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:15.048513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:15.048941 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:15.049626 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:15.050072 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:15.050490 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:15.207930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:15.218203 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-59118ae6-583f-466b-9945-79dbc5020dd5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.181479 Aug 09 11:33:15.218826 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 381/769] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:15 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:16.244048 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:16.245039 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:16.256195 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:16.256896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:16.257501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:16.258539 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:16.259246 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:16.259843 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:16.410551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:16.418933 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1e447b79-6583-4ac8-96b2-1dd7a6c2da51 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.181413 Aug 09 11:33:16.419496 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 389/770] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:16 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:17.443150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:17.443742 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:17.450985 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:17.451468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:17.451891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:17.452575 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:17.453091 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:17.453510 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:17.594867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:17.602992 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f887c41a-3dfd-4e0d-b942-eaaf964c5d8a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.164681 Aug 09 11:33:17.603564 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 382/771] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:17 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:18.624595 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:18.625292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:18.632159 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:18.632641 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:18.633070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:18.633759 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:18.634243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:18.634626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:18.769285 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:18.777218 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-34801a5d-37ce-4441-bf08-842801a60611 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.156528 Aug 09 11:33:18.777788 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 390/772] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:18 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:19.798466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:19.799066 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:19.805808 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:19.806293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:19.806729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:19.807460 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:19.807907 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:19.808332 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:19.955279 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:19.967217 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f256e6c2-0994-40a2-b4a5-974b10fb97ab tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.172735 Aug 09 11:33:19.968007 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 383/773] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:19 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:20.992532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:20.993076 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:20.999835 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:21.000356 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:21.000757 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:21.001459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:21.001912 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:21.002342 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:21.134876 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:21.143367 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-180318e9-a99c-4264-a296-e840a72249d0 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.154774 Aug 09 11:33:21.143947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 391/774] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:20 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:22.167491 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:22.168135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:22.170652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=34 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:22.176695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:22.177169 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:22.177599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:22.178292 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:22.178735 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:22.179212 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:22.326875 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:22.338609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9e79eaec-c047-44c2-a027-e980fd393e91 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.176639 Aug 09 11:33:22.339222 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 384/775] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:22 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:23.361288 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:23.361890 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:23.364418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=34 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:23.370063 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:23.370533 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:23.371022 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:23.371708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:23.372159 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:23.372565 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:23.514963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:23.523442 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2631fa01-beba-4677-81e8-e20edeae9704 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.166039 Aug 09 11:33:23.524031 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 392/776] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:23 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:24.546705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:24.547390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:24.555309 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:24.556026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:24.556530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:24.557447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:24.557936 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:24.558406 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:24.716582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:24.725038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c87c7206-3e5b-4310-9eab-3f2791120725 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.183203 Aug 09 11:33:24.725704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 385/777] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:24 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:25.748259 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:25.748825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:25.755791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:25.756364 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:25.756800 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:25.757504 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:25.757945 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:25.758366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:25.898447 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:25.906635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b5719879-9d48-4acb-bdee-7a17cf939a0a tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1509 microversion: 2.1 time: 0.162460 Aug 09 11:33:25.907267 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 393/778] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:25 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:25.927416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:33:25.928139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:25.935357 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:25.935844 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:25.936263 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:25.936974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:25.937413 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:25.937850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:25.988142 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117792) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 11:33:26.063474 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f089a7d4-f8dd-497d-b3da-c16811251da4 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "POST /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2/action" status: 202 len: 0 microversion: 2.1 time: 0.139801 Aug 09 11:33:26.064077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 386/779] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:33:25 2022] POST /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:33:26.075120 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:26.075836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:26.085830 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:26.086465 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:26.086931 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:26.087654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:26.088138 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:26.088557 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:26.250322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:26.258693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2b9759ff-421a-414e-9b33-e6d9633bcba5 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1517 microversion: 2.1 time: 0.189578 Aug 09 11:33:26.259300 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 394/780] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:26 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:27.280827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:27.281416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:27.288192 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:27.288672 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:27.289093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:27.289768 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:27.290213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:27.290630 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:27.435039 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:27.442661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-02875712-7cd4-42d9-954d-7a2a3896ed57 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1519 microversion: 2.1 time: 0.166374 Aug 09 11:33:27.443253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 387/781] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:27 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:28.464057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:28.464882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:28.472840 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:28.473336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:28.476362 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:28.477044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:28.477538 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:28.477982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:28.671591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-b3d84332-1cce-4ded-a98b-322aea40ecf0 req-07dd3c8f-6d1f-4223-afdc-91b012ceffdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafb83be-fb97-4c38-9818-862de58903e2", "name": "network-vif-unplugged", "status": "completed", "tag": "c7e24f87-826e-40ca-ae47-c2109c4d697b"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:33:28.685706 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b3d84332-1cce-4ded-a98b-322aea40ecf0 req-07dd3c8f-6d1f-4223-afdc-91b012ceffdd service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:28.686157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b3d84332-1cce-4ded-a98b-322aea40ecf0 req-07dd3c8f-6d1f-4223-afdc-91b012ceffdd service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:28.687268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b3d84332-1cce-4ded-a98b-322aea40ecf0 req-07dd3c8f-6d1f-4223-afdc-91b012ceffdd service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:28.700116 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-b3d84332-1cce-4ded-a98b-322aea40ecf0 req-07dd3c8f-6d1f-4223-afdc-91b012ceffdd service nova] Creating event network-vif-unplugged:c7e24f87-826e-40ca-ae47-c2109c4d697b for instance dafb83be-fb97-4c38-9818-862de58903e2 on hv-cinder-84989 Aug 09 11:33:28.705632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:28.714059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a712f55a-1487-4472-9825-8cb599110895 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1575 microversion: 2.1 time: 0.254422 Aug 09 11:33:28.714674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 395/782] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:28 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1575 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:28.717951 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-b3d84332-1cce-4ded-a98b-322aea40ecf0 req-07dd3c8f-6d1f-4223-afdc-91b012ceffdd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049874 Aug 09 11:33:28.718731 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 388/783] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:33:29.735807 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:29.736400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:29.743331 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:29.743824 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:29.744259 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:29.744976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:29.745418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:29.745923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:29.901179 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:29.906162 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:29.914072 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bd4c4b3b-27fa-4add-8082-1e76180b47b1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1575 microversion: 2.1 time: 0.181947 Aug 09 11:33:29.915037 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 396/784] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:29 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:30.939185 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:30.939902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:30.946643 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:30.947151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:30.947587 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:30.948285 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:30.948777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:30.949191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:31.098067 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:31.108170 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ea8fe96a-bbb6-4e98-b20d-ead6bbc62096 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1575 microversion: 2.1 time: 0.173324 Aug 09 11:33:31.108955 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 389/785] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:30 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:32.131383 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:32.132062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:32.143837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:32.144323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:32.144849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:32.145644 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:32.146143 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:32.146566 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:32.304400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:32.316504 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7cc2e154-0d19-4797-a818-39c77aebf1f6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1575 microversion: 2.1 time: 0.189712 Aug 09 11:33:32.317572 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 397/786] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:32 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:33.342100 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:33.342679 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:33.350362 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:33.350874 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:33.351446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:33.352172 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:33.352626 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:33.353039 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:33.498844 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:33.507001 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c429d6fe-8e6b-49c5-bb35-0f874bdbf1d3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1575 microversion: 2.1 time: 0.169584 Aug 09 11:33:33.507546 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 390/787] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:33 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:34.529644 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:34.530362 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:34.538096 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:34.538718 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:34.539173 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:34.539942 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:34.540438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:34.540923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:34.684372 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:34.692192 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-94f5df39-cdec-4ccc-a3f8-4310e970d482 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1575 microversion: 2.1 time: 0.166875 Aug 09 11:33:34.692760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 398/788] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:34 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:35.714801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:35.715405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:35.722452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:35.722956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:35.723377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:35.724061 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:35.724505 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:35.724923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:35.882008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:35.890166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4e55e891-7300-4662-83c9-738eaaab2df8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1575 microversion: 2.1 time: 0.179366 Aug 09 11:33:35.890755 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 391/789] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:35 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:36.917649 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:36.918456 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:36.927553 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:36.928321 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:36.929008 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:36.929758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:36.930229 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:36.930627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:37.103820 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:37.113151 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-64f6f3eb-f7a3-4902-800b-7a76c566f7fd tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1575 microversion: 2.1 time: 0.201327 Aug 09 11:33:37.113734 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 399/790] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:36 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:38.135108 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:38.135707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:38.142847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:38.143353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:38.143776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:38.144470 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:38.144933 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:38.145345 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:38.149662 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:38.285785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:38.294478 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7ec89884-3c9c-4f96-9698-280bfe2e186f tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1575 microversion: 2.1 time: 0.163185 Aug 09 11:33:38.295102 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 392/791] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:38 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:39.076959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-7ae8d7b5-6afd-433a-ba9b-533b668eeb86 req-86e8e907-0ae4-49d8-9a89-b2f94105a8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafb83be-fb97-4c38-9818-862de58903e2", "name": "network-vif-plugged", "status": "completed", "tag": "c7e24f87-826e-40ca-ae47-c2109c4d697b"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:33:39.088297 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7ae8d7b5-6afd-433a-ba9b-533b668eeb86 req-86e8e907-0ae4-49d8-9a89-b2f94105a8d6 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:39.088778 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7ae8d7b5-6afd-433a-ba9b-533b668eeb86 req-86e8e907-0ae4-49d8-9a89-b2f94105a8d6 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:39.089226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7ae8d7b5-6afd-433a-ba9b-533b668eeb86 req-86e8e907-0ae4-49d8-9a89-b2f94105a8d6 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:39.105240 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-7ae8d7b5-6afd-433a-ba9b-533b668eeb86 req-86e8e907-0ae4-49d8-9a89-b2f94105a8d6 service nova] Creating event network-vif-plugged:c7e24f87-826e-40ca-ae47-c2109c4d697b for instance dafb83be-fb97-4c38-9818-862de58903e2 on hv-cinder-84989 Aug 09 11:33:39.110676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-7ae8d7b5-6afd-433a-ba9b-533b668eeb86 req-86e8e907-0ae4-49d8-9a89-b2f94105a8d6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037586 Aug 09 11:33:39.111311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 400/792] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:33:39.317873 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:39.318483 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:39.325593 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:39.326080 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:39.326515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:39.327474 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:39.328018 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:39.328444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:39.474326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:39.485078 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f3f309cc-71d2-4bf2-bba3-6c7fb83f5928 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1562 microversion: 2.1 time: 0.171375 Aug 09 11:33:39.485652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 393/793] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:39 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:51.779881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:51.780427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:51.783684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=17 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:51.784327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=20 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:51.792090 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:51.792752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:51.793367 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:51.794291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:51.794978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:51.795529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:51.880854 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lazy-loading 'services' on Instance uuid 8c922f63-17a0-4421-bd4d-7a4430540a29 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:33:51.964756 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6294362b-febe-48f6-b8f6-6b1f4d9e656a tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments/69fc5377-37d0-46d4-afeb-140a87001870" status: 202 len: 0 microversion: 2.1 time: 0.191335 Aug 09 11:33:51.965302 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 401/794] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:33:51 2022] DELETE /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments/69fc5377-37d0-46d4-afeb-140a87001870 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:33:51.974461 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-825fadea-82bf-47a4-9d00-89f793e0664b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:51.976687 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-825fadea-82bf-47a4-9d00-89f793e0664b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:51.980286 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:51.980925 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=10 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:51.984589 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-825fadea-82bf-47a4-9d00-89f793e0664b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:51.985035 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-825fadea-82bf-47a4-9d00-89f793e0664b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:51.985443 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-825fadea-82bf-47a4-9d00-89f793e0664b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:51.986119 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-825fadea-82bf-47a4-9d00-89f793e0664b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:51.986740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-825fadea-82bf-47a4-9d00-89f793e0664b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:51.987222 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-825fadea-82bf-47a4-9d00-89f793e0664b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:52.020128 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-825fadea-82bf-47a4-9d00-89f793e0664b tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049609 Aug 09 11:33:52.020809 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 394/795] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:33:51 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:33:53.036463 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9f10f011-0525-4471-8ebc-3622e157c6af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:53.038720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9f10f011-0525-4471-8ebc-3622e157c6af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:53.046127 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f10f011-0525-4471-8ebc-3622e157c6af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:53.046704 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f10f011-0525-4471-8ebc-3622e157c6af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:53.047161 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f10f011-0525-4471-8ebc-3622e157c6af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:53.047882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f10f011-0525-4471-8ebc-3622e157c6af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:53.048357 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f10f011-0525-4471-8ebc-3622e157c6af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:53.048817 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f10f011-0525-4471-8ebc-3622e157c6af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:53.079810 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9f10f011-0525-4471-8ebc-3622e157c6af tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049769 Aug 09 11:33:53.080392 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 402/796] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:33:53 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:33:53.163175 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:53.163748 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:53.170324 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:53.170984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:53.171566 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:53.172265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:53.172741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:53.173196 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:53.200299 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:33:53.280384 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e859ac3d-15ff-49ad-93f0-69cce6d68224 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 204 len: 0 microversion: 2.1 time: 0.120816 Aug 09 11:33:53.280867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 395/797] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:33:53 2022] DELETE /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:33:53.288922 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:53.289525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:53.304691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:53.305182 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:53.305622 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:53.306329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:53.306783 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:53.307336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:53.454368 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:53.462551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3bc5d16d-0566-413a-857a-f88ec71bf0b4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1687 microversion: 2.1 time: 0.177372 Aug 09 11:33:53.463181 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 403/798] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:53 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:54.484418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:54.485118 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:54.492001 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:54.492480 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:54.492908 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:54.493596 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:54.494038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:54.494427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:54.636436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:54.645972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6a8cd995-1b50-49c7-bdaa-b1502469396f tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1687 microversion: 2.1 time: 0.165899 Aug 09 11:33:54.646541 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 396/799] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:54 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:55.667728 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:55.668299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:55.675175 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:55.675665 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:55.676097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:55.676797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:55.677255 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:55.677682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:55.829056 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:55.840864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-841dda3d-6dd0-418c-8e69-759874f663ad tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1687 microversion: 2.1 time: 0.176844 Aug 09 11:33:55.841718 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 404/800] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:55 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:56.869943 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:56.870579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:56.877472 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:56.877955 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:56.878387 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:56.879118 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:56.879568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:56.879994 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:57.017003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:57.024690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3a7ef882-a8bc-406b-ad09-1d1a443da0a9 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1687 microversion: 2.1 time: 0.158674 Aug 09 11:33:57.025285 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 397/801] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:56 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:58.046214 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:58.047023 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:58.053485 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:58.053978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:58.054947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:58.055264 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:58.055715 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:58.056137 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:58.250908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:33:58.260626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d1e00764-9658-414c-8316-2bf43dd9f743 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 200 len: 1687 microversion: 2.1 time: 0.218771 Aug 09 11:33:58.261524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 405/802] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:58 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 1687 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:33:58.620888 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-b4e2b72e-03d5-47f5-97d6-d425de9de99c req-b09a4fed-a43f-469a-8767-888e6cb392c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c922f63-17a0-4421-bd4d-7a4430540a29", "name": "network-vif-deleted", "tag": "d007e409-d8a8-4797-bfb3-ed337e9631c6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:33:58.633209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b4e2b72e-03d5-47f5-97d6-d425de9de99c req-b09a4fed-a43f-469a-8767-888e6cb392c8 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:58.633682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b4e2b72e-03d5-47f5-97d6-d425de9de99c req-b09a4fed-a43f-469a-8767-888e6cb392c8 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:58.634139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b4e2b72e-03d5-47f5-97d6-d425de9de99c req-b09a4fed-a43f-469a-8767-888e6cb392c8 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:58.648358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-b4e2b72e-03d5-47f5-97d6-d425de9de99c req-b09a4fed-a43f-469a-8767-888e6cb392c8 service nova] Creating event network-vif-deleted:d007e409-d8a8-4797-bfb3-ed337e9631c6 for instance 8c922f63-17a0-4421-bd4d-7a4430540a29 on hv-cinder-84989 Aug 09 11:33:58.654844 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-b4e2b72e-03d5-47f5-97d6-d425de9de99c req-b09a4fed-a43f-469a-8767-888e6cb392c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037256 Aug 09 11:33:58.659948 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 398/803] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:33:59.287221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:59.288027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 8c922f63-17a0-4421-bd4d-7a4430540a29] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:33:59.299438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:59.299906 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:59.300331 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:59.301026 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:33:59.301481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:33:59.301896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:33:59.316003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] HTTP exception thrown: Instance 8c922f63-17a0-4421-bd4d-7a4430540a29 could not be found. Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Request method failure captured: Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 HTTP/1.1 Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRG0rpW3sj4nheZdhbCxPm1Z5jfdUcOxP527qQ7_jhokZykFQKs4TqP5xopsG9oPMsNJkr1PNRrC0MRk4UMMaYA88FH_DuQHQWbKZ_AZE6sayLLRgjaZLDJoymwC7JncPc5njCMgeqjV2Sb9VT0FTc_qt5jZ6gsr1fDQYvwfbnyN-o Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:33:59.317657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b0a6fd5299a7475bad7836d22b23967d", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8f9dc600fea34effa2afa8aee54aab7e Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 8c922f63-17a0-4421-bd4d-7a4430540a29 could not be found. Aug 09 11:33:59.319125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '8c922f63-17a0-4421-bd4d-7a4430540a29'} Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c922f63-17a0-4421-bd4d-7a4430540a29 could not be found. Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:33:59.319976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c922f63-17a0-4421-bd4d-7a4430540a29 could not be found. Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c922f63-17a0-4421-bd4d-7a4430540a29 could not be found. Aug 09 11:33:59.321498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:33:59.322799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Returning 404 to user: Instance 8c922f63-17a0-4421-bd4d-7a4430540a29 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:33:59.322799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-72ce7e1d-4a3d-48a2-ab34-27042aaa728d tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29" status: 404 len: 111 microversion: 2.1 time: 0.036101 Aug 09 11:33:59.322799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 406/804] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:33:59 2022] GET /compute/v2.1/servers/8c922f63-17a0-4421-bd4d-7a4430540a29 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:33:59.328426 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4d874b2d-ed24-4f59-be36-f790f27d1ed8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '.version_select at 0x7fece2493b80>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:33:59.349272 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4d874b2d-ed24-4f59-be36-f790f27d1ed8 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-760856355" status: 202 len: 0 microversion: 2.1 time: 0.025110 Aug 09 11:33:59.349862 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 399/805] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Aug 9 11:33:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-760856355 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:34:02.245950 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:02.246546 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:02.253408 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:02.253912 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:02.254461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:02.255258 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:02.255707 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:02.256126 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:02.286697 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:34:02.365211 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-76f1be00-3415-4d71-8cf7-b0f5567e6dc4 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 204 len: 0 microversion: 2.1 time: 0.122914 Aug 09 11:34:02.366169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 407/806] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:34:02 2022] DELETE /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:34:02.376946 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:02.378328 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:02.385194 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:02.385709 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:02.386180 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:02.386927 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:02.387381 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:02.387818 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:02.531003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:02.539146 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d3694c01-c369-4219-bd00-f555769d7dce tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1509 microversion: 2.1 time: 0.167778 Aug 09 11:34:02.539739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 400/807] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:02 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:03.566716 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:03.567426 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:03.574851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:03.575338 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:03.575776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:03.576488 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:03.576999 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:03.577422 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:03.948978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:03.957111 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-da77732a-5166-4366-a858-f6a4fb78f378 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1509 microversion: 2.1 time: 0.394972 Aug 09 11:34:03.957691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 408/808] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:03 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:04.353551 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-f5403652-ff7e-49cb-8d8a-960586a93b2c req-29d15196-9a60-4aa8-9c71-529ac94e87b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a396c8a-da73-40f4-b239-d344970cdbcd", "name": "network-vif-deleted", "tag": "c02f7ff1-bbb1-4b12-b948-d5b92e1df60a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:04.364383 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f5403652-ff7e-49cb-8d8a-960586a93b2c req-29d15196-9a60-4aa8-9c71-529ac94e87b4 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:04.364866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f5403652-ff7e-49cb-8d8a-960586a93b2c req-29d15196-9a60-4aa8-9c71-529ac94e87b4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:04.365489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-f5403652-ff7e-49cb-8d8a-960586a93b2c req-29d15196-9a60-4aa8-9c71-529ac94e87b4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:04.383255 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-f5403652-ff7e-49cb-8d8a-960586a93b2c req-29d15196-9a60-4aa8-9c71-529ac94e87b4 service nova] Creating event network-vif-deleted:c02f7ff1-bbb1-4b12-b948-d5b92e1df60a for instance 5a396c8a-da73-40f4-b239-d344970cdbcd on hv-cinder-84989 Aug 09 11:34:04.393352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-f5403652-ff7e-49cb-8d8a-960586a93b2c req-29d15196-9a60-4aa8-9c71-529ac94e87b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043492 Aug 09 11:34:04.395481 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 401/809] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:04.987316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:04.987998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:04.994898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:04.995416 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:04.995877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:04.996773 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:04.997224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:04.997650 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:05.030972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:05.031463 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:05.031926 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:05.032382 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lazy-loading 'fault' on Instance uuid 5a396c8a-da73-40f4-b239-d344970cdbcd {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:34:05.088225 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:05.095110 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a168bef5-a712-4879-bfe5-4a7be2f65a3e tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 200 len: 1312 microversion: 2.1 time: 0.120713 Aug 09 11:34:05.095692 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 409/810] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:04 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:06.117341 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:06.118025 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: 5a396c8a-da73-40f4-b239-d344970cdbcd] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:06.125160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:06.125636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:06.126058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:06.126748 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:06.127230 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:06.127646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:06.141879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] HTTP exception thrown: Instance 5a396c8a-da73-40f4-b239-d344970cdbcd could not be found. Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Request method failure captured: Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd HTTP/1.1 Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRG0rpW3sj4nheZdhbCxPm1Z5jfdUcOxP527qQ7_jhokZykFQKs4TqP5xopsG9oPMsNJkr1PNRrC0MRk4UMMaYA88FH_DuQHQWbKZ_AZE6sayLLRgjaZLDJoymwC7JncPc5njCMgeqjV2Sb9VT0FTc_qt5jZ6gsr1fDQYvwfbnyN-o Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:34:06.143559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b0a6fd5299a7475bad7836d22b23967d", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 8f9dc600fea34effa2afa8aee54aab7e Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 5a396c8a-da73-40f4-b239-d344970cdbcd could not be found. Aug 09 11:34:06.145353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '5a396c8a-da73-40f4-b239-d344970cdbcd'} Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a396c8a-da73-40f4-b239-d344970cdbcd could not be found. Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:34:06.146527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a396c8a-da73-40f4-b239-d344970cdbcd could not be found. Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a396c8a-da73-40f4-b239-d344970cdbcd could not be found. Aug 09 11:34:06.148126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:06.149561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Returning 404 to user: Instance 5a396c8a-da73-40f4-b239-d344970cdbcd could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:34:06.149561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d3626d8d-b5b1-4993-bf1a-2ad53dd40bfd tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd" status: 404 len: 111 microversion: 2.1 time: 0.032336 Aug 09 11:34:06.149561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 402/811] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:06 2022] GET /compute/v2.1/servers/5a396c8a-da73-40f4-b239-d344970cdbcd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:34:06.155531 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:06.156027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:06.162856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:06.163370 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:06.163830 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:06.164551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:06.165024 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:06.165466 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:06.193834 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:34:06.294471 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ecefb4cf-a3c4-44e8-958c-1d48a69185ef tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 204 len: 0 microversion: 2.1 time: 0.144306 Aug 09 11:34:06.295157 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 410/812] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:34:06 2022] DELETE /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:34:06.304038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:06.304635 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:06.310821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:06.311425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:06.311854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:06.312564 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:06.312978 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:06.313390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:06.453689 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:06.462749 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5502f848-c066-4965-9d28-9e398ed67ee2 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.162792 Aug 09 11:34:06.463374 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 403/813] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:06 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:34:07.485303 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:07.486104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:07.493086 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:07.493571 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:07.493966 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:07.494961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:07.495411 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:07.495830 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:07.576142 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5b9620ac-da30-46ad-b4f2-d7c7110239ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:07.578656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5b9620ac-da30-46ad-b4f2-d7c7110239ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:07.586086 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b9620ac-da30-46ad-b4f2-d7c7110239ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:07.586651 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b9620ac-da30-46ad-b4f2-d7c7110239ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:07.587126 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b9620ac-da30-46ad-b4f2-d7c7110239ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:07.587851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b9620ac-da30-46ad-b4f2-d7c7110239ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:07.588300 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b9620ac-da30-46ad-b4f2-d7c7110239ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:07.588773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5b9620ac-da30-46ad-b4f2-d7c7110239ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:07.631946 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9dc600fea34effa2afa8aee54aab7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a6fd5299a7475bad7836d22b23967d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:07.642050 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d75940b5-26f4-430e-a9e2-2a6c3122f630 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 200 len: 1521 microversion: 2.1 time: 0.161832 Aug 09 11:34:07.643138 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 411/814] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:07 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:07.679568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5b9620ac-da30-46ad-b4f2-d7c7110239ba tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "POST /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/action" status: 202 len: 0 microversion: 2.1 time: 0.107514 Aug 09 11:34:07.680427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 404/815] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:34:07 2022] POST /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:34:07.689089 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:07.690005 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:07.696377 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:07.697034 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:07.697648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:07.698469 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:07.698959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:07.699412 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:07.939667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:07.949332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a612c74d-cd76-45a0-a53f-3142f6a4b729 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1752 microversion: 2.1 time: 0.264169 Aug 09 11:34:07.967263 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-eaad94ef-4b36-4295-8842-f21195d14fd9 req-2d9d7291-bbb9-422b-bb59-4c5037017028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f727a3f9-56c8-4305-bcd5-68f8d6d31f79", "name": "network-vif-deleted", "tag": "2f3704c5-212e-4b8b-b7e6-10d9252525b6"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:07.967263 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-eaad94ef-4b36-4295-8842-f21195d14fd9 req-2d9d7291-bbb9-422b-bb59-4c5037017028 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:07.967263 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-eaad94ef-4b36-4295-8842-f21195d14fd9 req-2d9d7291-bbb9-422b-bb59-4c5037017028 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:07.967263 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-eaad94ef-4b36-4295-8842-f21195d14fd9 req-2d9d7291-bbb9-422b-bb59-4c5037017028 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:07.968329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 412/816] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:07 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1752 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:07.978119 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-eaad94ef-4b36-4295-8842-f21195d14fd9 req-2d9d7291-bbb9-422b-bb59-4c5037017028 service nova] Creating event network-vif-deleted:2f3704c5-212e-4b8b-b7e6-10d9252525b6 for instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 on hv-cinder-84989 Aug 09 11:34:07.983478 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-eaad94ef-4b36-4295-8842-f21195d14fd9 req-2d9d7291-bbb9-422b-bb59-4c5037017028 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034702 Aug 09 11:34:07.984149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 405/817] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:34:08.663967 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:08.664768 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] [instance: f727a3f9-56c8-4305-bcd5-68f8d6d31f79] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:08.674562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:08.675321 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:08.675974 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:08.677019 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:08.677720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:08.678355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:08.693245 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] HTTP exception thrown: Instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 could not be found. Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Request method failure captured: Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 HTTP/1.1 Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRG0rpW3sj4nheZdhbCxPm1Z5jfdUcOxP527qQ7_jhokZykFQKs4TqP5xopsG9oPMsNJkr1PNRrC0MRk4UMMaYA88FH_DuQHQWbKZ_AZE6sayLLRgjaZLDJoymwC7JncPc5njCMgeqjV2Sb9VT0FTc_qt5jZ6gsr1fDQYvwfbnyN-o Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:34:08.694948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b0a6fd5299a7475bad7836d22b23967d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b0a6fd5299a7475bad7836d22b23967d", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b0a6fd5299a7475bad7836d22b23967d Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829120170 Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8f9dc600fea34effa2afa8aee54aab7e Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829120170-project Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 could not be found. Aug 09 11:34:08.696674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': 'f727a3f9-56c8-4305-bcd5-68f8d6d31f79'} Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 could not be found. Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:34:08.697676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 could not be found. Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 could not be found. Aug 09 11:34:08.699104 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:08.700481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] Returning 404 to user: Instance f727a3f9-56c8-4305-bcd5-68f8d6d31f79 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:34:08.700481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7e692c04-1785-4dc4-8534-2caef6ed4577 tempest-ServerRescueNegativeTestJSON-1829120170 tempest-ServerRescueNegativeTestJSON-1829120170-project] 10.222.0.59 "GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79" status: 404 len: 111 microversion: 2.1 time: 0.036471 Aug 09 11:34:08.700481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 413/818] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:08 2022] GET /compute/v2.1/servers/f727a3f9-56c8-4305-bcd5-68f8d6d31f79 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:34:08.975480 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:08.976107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:08.983307 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:08.983862 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:08.984287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:08.985022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:08.985729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:08.986186 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:09.139590 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:09.148178 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4dc7e21c-46be-4149-8ba7-2a2d0cf3a48c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1757 microversion: 2.1 time: 0.177743 Aug 09 11:34:09.148758 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 406/819] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:08 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:10.169786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:10.170354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:10.177493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:10.178068 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:10.178483 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:10.179200 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:10.179647 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:10.180088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:10.198367 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:10.329201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:10.337762 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-17b23afc-84b3-4dea-9593-ddc215957a33 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1757 microversion: 2.1 time: 0.171923 Aug 09 11:34:10.338366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 414/820] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:10 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:11.359683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:11.360630 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:11.371665 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:11.375607 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:11.376173 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:11.376921 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:11.377408 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:11.377851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:11.557513 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:11.567461 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-69c9b3fa-7f6a-404a-aa59-0f69b82e6abb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1757 microversion: 2.1 time: 0.211800 Aug 09 11:34:11.568095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 407/821] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:11 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:12.590902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:12.592495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:12.600199 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:12.600733 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:12.601262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:12.602001 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:12.602487 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:12.602972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:12.762202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:12.772748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b7bb2f1a-ba1a-4bb3-936b-7417935f1c1d tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1757 microversion: 2.1 time: 0.186624 Aug 09 11:34:12.773634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 415/822] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:12 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:13.799865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:13.800617 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:13.808257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:13.808818 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:13.809245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:13.809940 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:13.810389 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:13.811309 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:14.060742 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:14.069066 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c0c58d3e-38c2-4735-9b32-36169ce9c2e1 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1757 microversion: 2.1 time: 0.273982 Aug 09 11:34:14.069623 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 408/823] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:13 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1757 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:15.091958 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:15.093311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:15.100017 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.100505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.100939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.101644 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.102102 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.102524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.274265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3f2aebbf-8e15-41eb-a488-d8e19c5e370a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:15.274868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3f2aebbf-8e15-41eb-a488-d8e19c5e370a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:15.281746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f2aebbf-8e15-41eb-a488-d8e19c5e370a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.282403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f2aebbf-8e15-41eb-a488-d8e19c5e370a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.283044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f2aebbf-8e15-41eb-a488-d8e19c5e370a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.283834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f2aebbf-8e15-41eb-a488-d8e19c5e370a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.284381 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f2aebbf-8e15-41eb-a488-d8e19c5e370a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.284888 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3f2aebbf-8e15-41eb-a488-d8e19c5e370a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.309505 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3f2aebbf-8e15-41eb-a488-d8e19c5e370a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/ips" status: 200 len: 148 microversion: 2.1 time: 0.039253 Aug 09 11:34:15.310378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 409/824] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:34:15 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:15.352658 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:15.363153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b348033b-bb23-4e82-9040-0cac68399e85 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1757 microversion: 2.1 time: 0.276928 Aug 09 11:34:15.364176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 416/825] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:15 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1757 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:15.391964 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0f42a183-7110-4d7a-9cb3-abc049518ceb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:15.395193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0f42a183-7110-4d7a-9cb3-abc049518ceb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:15.401590 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0f42a183-7110-4d7a-9cb3-abc049518ceb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.402580 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0f42a183-7110-4d7a-9cb3-abc049518ceb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.402941 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0f42a183-7110-4d7a-9cb3-abc049518ceb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.403649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0f42a183-7110-4d7a-9cb3-abc049518ceb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.404099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0f42a183-7110-4d7a-9cb3-abc049518ceb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.404519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0f42a183-7110-4d7a-9cb3-abc049518ceb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.438783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0f42a183-7110-4d7a-9cb3-abc049518ceb tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050576 Aug 09 11:34:15.439183 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 410/826] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:34:15 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:34:15.511930 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:15.512682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:15.519662 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.520162 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.520594 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.521310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.521857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.522181 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.550460 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:34:15.701015 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5cd63d03-fd9e-40c2-b539-547ae2b08524 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 204 len: 0 microversion: 2.1 time: 0.193000 Aug 09 11:34:15.702332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 417/827] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:34:15 2022] DELETE /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:34:15.711864 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:15.712811 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:15.728714 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.729373 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.729835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.730591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:15.731089 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:15.731658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:15.956014 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:15.960027 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:15.965409 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-44781d6e-7803-4801-8719-8e58f2bc8fca tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1674 microversion: 2.1 time: 0.258270 Aug 09 11:34:15.965982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 411/828] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:15 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1674 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:16.388578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:16.389460 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:16.396706 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:16.397367 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:16.397902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:16.398846 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:16.404304 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:16.405099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:16.598724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:16.607467 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5215470a-1319-49dd-a779-854b38172619 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1757 microversion: 2.1 time: 0.224817 Aug 09 11:34:16.619021 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 418/829] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:16 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:16.788310 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-99964f19-8add-4358-b313-78bad272dfee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f41c2ca2-42da-4d8e-8fe6-28a765059caa"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:16.791987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-99964f19-8add-4358-b313-78bad272dfee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:16.800069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99964f19-8add-4358-b313-78bad272dfee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:16.800561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99964f19-8add-4358-b313-78bad272dfee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:16.801169 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99964f19-8add-4358-b313-78bad272dfee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:16.802169 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99964f19-8add-4358-b313-78bad272dfee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:16.802485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99964f19-8add-4358-b313-78bad272dfee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:16.803003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-99964f19-8add-4358-b313-78bad272dfee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:16.995172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:16.997765 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:17.019217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:17.023485 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:17.025058 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:17.027131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:17.028661 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:17.031404 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:17.488425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-99964f19-8add-4358-b313-78bad272dfee tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703140 Aug 09 11:34:17.489280 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 412/830] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:34:16 2022] POST /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:17.633218 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:17.634504 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:17.646038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:17.650915 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:17.651607 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:17.652488 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:17.657178 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:17.658005 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:17.799777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:17.813523 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a4bdf2c3-f9d2-4e13-87b0-2f488db6da2b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1674 microversion: 2.1 time: 0.828967 Aug 09 11:34:17.814840 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 419/831] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:16 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1674 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:17.979492 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:17.999097 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-dca9ea0d-f169-42a3-b093-f18bbc46a8ed tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1757 microversion: 2.1 time: 0.372432 Aug 09 11:34:18.000783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 413/832] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:17 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1757 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:18.418384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-895d3906-00da-4568-9295-f9861cad6218 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'create', calling method: .version_select at 0x7fece23b5e50>, body: {"keypair": {"name": "tempest-keypair-1532724460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4ciOdMc7G9ALFnD8cuZzt0YptNwfW/mb2s8GVGDQLzwI6EK4XFnRiD70z06fqRh0ru9w4wpKyQiEjnwbWdTdbkvtLZsnigvbaV3voamQYemUrKRYd/bHj8iK0xrYCtJA=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:18.436874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-895d3906-00da-4568-9295-f9861cad6218 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Getting quotas for project 4f10ad025e8e405e82f06156adef690e. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:34:18.444716 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-895d3906-00da-4568-9295-f9861cad6218 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Getting quotas for user 62968629eb0e4ccf8713787d6c4aef5b and project 4f10ad025e8e405e82f06156adef690e. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:34:18.482374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-895d3906-00da-4568-9295-f9861cad6218 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.298372 Aug 09 11:34:18.487642 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 420/833] 10.222.0.59 () {62 vars in 1200 bytes} [Tue Aug 9 11:34:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 305 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 11:34:18.824442 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-8af0c881-002d-465b-876f-58762fb9ab3a req-f3079c76-6d37-44a3-b213-06eadc1a0966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26bbe60e-21bf-4703-8873-5190575e1ec9", "name": "network-vif-deleted", "tag": "a8812474-eb48-4bb8-8c0f-cf18de6d6ba5"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:18.839480 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:18.851861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:18.868072 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-8af0c881-002d-465b-876f-58762fb9ab3a req-f3079c76-6d37-44a3-b213-06eadc1a0966 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:18.869853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-8af0c881-002d-465b-876f-58762fb9ab3a req-f3079c76-6d37-44a3-b213-06eadc1a0966 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:18.871692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-8af0c881-002d-465b-876f-58762fb9ab3a req-f3079c76-6d37-44a3-b213-06eadc1a0966 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:18.876447 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:18.877944 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:18.879522 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:18.880540 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:18.881236 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:18.881857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:18.895218 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-8af0c881-002d-465b-876f-58762fb9ab3a req-f3079c76-6d37-44a3-b213-06eadc1a0966 service nova] Creating event network-vif-deleted:a8812474-eb48-4bb8-8c0f-cf18de6d6ba5 for instance 26bbe60e-21bf-4703-8873-5190575e1ec9 on hv-cinder-84989 Aug 09 11:34:18.944292 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-8af0c881-002d-465b-876f-58762fb9ab3a req-f3079c76-6d37-44a3-b213-06eadc1a0966 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124895 Aug 09 11:34:18.945993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 414/834] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:19.006202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:19.017521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a693848f-b55e-41ad-badc-e0114bcab717 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1606 microversion: 2.1 time: 0.183342 Aug 09 11:34:19.019485 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 421/835] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:18 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1606 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:19.027802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:19.034664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:19.050179 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:19.050682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:19.051321 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:19.052042 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:19.052690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:19.053196 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:19.422770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:19.434256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e45495ae-37ab-4f33-ac66-a376c9b7f071 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1757 microversion: 2.1 time: 0.413399 Aug 09 11:34:19.435419 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 415/836] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:19 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1757 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:34:20.044646 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:20.045210 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:20.052064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:20.052547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:20.052984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:20.053665 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:20.054317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:20.054744 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:20.087418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:20.087998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:20.088502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:20.089011 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lazy-loading 'fault' on Instance uuid 26bbe60e-21bf-4703-8873-5190575e1ec9 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:34:20.139598 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:20.148125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-85fe5171-dce6-43f1-a400-3ac89a0b4ba6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 200 len: 1328 microversion: 2.1 time: 0.107332 Aug 09 11:34:20.148712 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 422/837] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:20 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:20.317795 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-974177023", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c92a35cf-69f7-4b18-8b19-cdd4b5aa40f4"}], "security_groups": [{"name": "tempest-securitygroup--1491377655"}], "key_name": "tempest-keypair-1532724460", "user_data": "}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:20.426085 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] validate_networks() for [('c92a35cf-69f7-4b18-8b19-cdd4b5aa40f4', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:34:20.457742 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:20.458747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:20.466543 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:20.467727 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:20.468172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:20.468889 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:20.469482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:20.469905 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:20.730576 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:20.755144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6910a5ed-3787-4291-a1d1-473dd4889e4a tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1760 microversion: 2.1 time: 0.301234 Aug 09 11:34:20.759302 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 423/838] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:20 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1760 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:20.894273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f41c2ca2-42da-4d8e-8fe6-28a765059caa"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:20.898342 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:20.904528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:20.905172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:20.905706 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:20.906540 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:20.907319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:20.907817 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:21.004923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:34:21.005435 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Invalid volume: volume f41c2ca2-42da-4d8e-8fe6-28a765059caa is already attached to instances: 8788b6bb-2936-4358-9a4d-6322062d8708 Aug 09 11:34:21.005592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:34:21.006161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:34:21.006847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments HTTP/1.1 Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 74 Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:34:21.007291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {"volumeAttachment": {"volumeId": "f41c2ca2-42da-4d8e-8fe6-28a765059caa"}} Aug 09 11:34:21.008900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Invalid volume: volume f41c2ca2-42da-4d8e-8fe6-28a765059caa is already attached to instances: 8788b6bb-2936-4358-9a4d-6322062d8708 Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'server_id': '8788b6bb-2936-4358-9a4d-6322062d8708', 'body': {'volumeAttachment': {'volumeId': 'f41c2ca2-42da-4d8e-8fe6-28a765059caa'}}} Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f41c2ca2-42da-4d8e-8fe6-28a765059caa is already attached to instances: 8788b6bb-2936-4358-9a4d-6322062d8708 Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.009760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f41c2ca2-42da-4d8e-8fe6-28a765059caa is already attached to instances: 8788b6bb-2936-4358-9a4d-6322062d8708 Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:21.011166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:21.012446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:21.012446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:34:21.012446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:34:21.012446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f41c2ca2-42da-4d8e-8fe6-28a765059caa is already attached to instances: 8788b6bb-2936-4358-9a4d-6322062d8708 Aug 09 11:34:21.012446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.012764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:34:21.012844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 400 to user: Invalid volume: volume f41c2ca2-42da-4d8e-8fe6-28a765059caa is already attached to instances: 8788b6bb-2936-4358-9a4d-6322062d8708 {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:34:21.012844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8f69f941-711d-46c3-a5fb-c08de2ea97b4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123539 Aug 09 11:34:21.012844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 424/839] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:34:20 2022] POST /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:34:21.026322 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:21.026903 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:21.027275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:21.028160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:21.028772 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:21.029205 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:21.057362 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Getting quotas for project 4f10ad025e8e405e82f06156adef690e. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:34:21.061820 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Getting quotas for user 62968629eb0e4ccf8713787d6c4aef5b and project 4f10ad025e8e405e82f06156adef690e. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:34:21.078463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:34:21.078463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:34:21.087652 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:21.088183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:21.099461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:21.099984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:21.100508 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:21.101155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:21.102035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:21.102723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:21.134762 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f2133c1a-15a1-42d3-ac9f-42a40778f107 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.821397 Aug 09 11:34:21.136217 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 416/840] 10.222.0.59 () {62 vars in 1188 bytes} [Tue Aug 9 11:34:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 11:34:21.149328 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-648e1f83-c111-4c0d-9c63-72b19235f79c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:21.150192 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-648e1f83-c111-4c0d-9c63-72b19235f79c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:21.227788 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-648e1f83-c111-4c0d-9c63-72b19235f79c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:21.235407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lazy-loading 'services' on Instance uuid 8788b6bb-2936-4358-9a4d-6322062d8708 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:34:21.237549 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-648e1f83-c111-4c0d-9c63-72b19235f79c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:21.239284 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-648e1f83-c111-4c0d-9c63-72b19235f79c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:21.240401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-648e1f83-c111-4c0d-9c63-72b19235f79c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1281 microversion: 2.20 time: 0.096619 Aug 09 11:34:21.240944 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 417/841] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:21 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:34:21.251818 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:21.253559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:21.265272 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:21.266190 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:21.266590 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:21.267510 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:21.267966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:21.268395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:21.283835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] HTTP exception thrown: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Request method failure captured: Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 HTTP/1.1 Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kSmKvDFTiK0haaRbWM_acg7l17AV8YDEwtcet0RoXCUlfqnVDAtEhsVsKLC1OezaVAc7YEdpK4MJPrMv8h_Gfui7uKiLyZxOB61Rl3ATj-vew0huthltsAWG6k6uZMkV5n8teUAGeZNQszFwRzX-aI-4oZnDRFLQzh6P-1c9hh8PPw Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:34:21.285530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_001b779aebf8445eba01022c8c9abe19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 0f80c1f4f2d04a9b80ab0c315dfe180d Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:34:21.287224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '26bbe60e-21bf-4703-8873-5190575e1ec9'} Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:34:21.288134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:34:21.289611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:21.290926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Returning 404 to user: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:34:21.290926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6427d0cc-d2be-49c1-8b1f-657f68810dba tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 404 len: 111 microversion: 2.1 time: 0.042204 Aug 09 11:34:21.291080 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 418/842] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:21 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:34:21.296016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ebf7cf29-fe4c-4fcf-9c17-6255c3f6ba35 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '.version_select at 0x7fece251dca0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:21.322300 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ebf7cf29-fe4c-4fcf-9c17-6255c3f6ba35 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897874492" status: 202 len: 0 microversion: 2.1 time: 0.030109 Aug 09 11:34:21.326673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 419/843] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 9 11:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897874492 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:34:21.381556 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-acfe32b6-b464-4bea-9838-6a0322b97765 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments/f41c2ca2-42da-4d8e-8fe6-28a765059caa" status: 202 len: 0 microversion: 2.1 time: 0.301085 Aug 09 11:34:21.383004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 425/844] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:34:21 2022] DELETE /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments/f41c2ca2-42da-4d8e-8fe6-28a765059caa => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:34:21.397086 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-226a4124-8f6c-43ba-9f3c-1c3b13e40969 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:21.412714 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-226a4124-8f6c-43ba-9f3c-1c3b13e40969 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:21.426662 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-226a4124-8f6c-43ba-9f3c-1c3b13e40969 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:21.427717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-226a4124-8f6c-43ba-9f3c-1c3b13e40969 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:21.428344 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-226a4124-8f6c-43ba-9f3c-1c3b13e40969 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:21.430208 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-226a4124-8f6c-43ba-9f3c-1c3b13e40969 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:21.439241 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-226a4124-8f6c-43ba-9f3c-1c3b13e40969 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:21.442212 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-226a4124-8f6c-43ba-9f3c-1c3b13e40969 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:21.490342 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-226a4124-8f6c-43ba-9f3c-1c3b13e40969 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102609 Aug 09 11:34:21.495473 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 420/845] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:34:21 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:34:22.061825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-84524103-6204-49f6-a20c-8b407ed4300c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'create', calling method: .version_select at 0x7fece23a5b80>, body: {"keypair": {"name": "tempest-keypair-2128157752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKk2Zz+tIjqa2yxC4r0Y03wi4mcVSmxZanByP4UPtIojDsPDbkZpdQCTchh9ocLmoZ/sACHRhBkGfLOpYoQjl5KjpyP2t2RzCcqnUhd2QHaXIHCDYKVKPIS/QYO4vdUuA=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:22.067382 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:22.084885 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-84524103-6204-49f6-a20c-8b407ed4300c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Getting quotas for project 001b779aebf8445eba01022c8c9abe19. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:34:22.090202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-84524103-6204-49f6-a20c-8b407ed4300c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Getting quotas for user 0f80c1f4f2d04a9b80ab0c315dfe180d and project 001b779aebf8445eba01022c8c9abe19. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:34:22.117112 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-84524103-6204-49f6-a20c-8b407ed4300c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060326 Aug 09 11:34:22.118309 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 426/846] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:34:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:34:22.263699 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:22.264318 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:22.266446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:22.272491 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:22.273256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:22.273939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:22.274863 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:22.275479 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:22.276058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:22.366172 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:22.380296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:22.381885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:22.383068 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-54d0f3c7-b6d1-4a2b-8cba-7bd09a17817f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1333 microversion: 2.20 time: 0.123579 Aug 09 11:34:22.384260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 421/847] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:22 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:34:22.509074 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ec1f1935-49ce-4ffa-bce3-f3feee463abd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:22.511426 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ec1f1935-49ce-4ffa-bce3-f3feee463abd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:22.519143 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec1f1935-49ce-4ffa-bce3-f3feee463abd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:22.525688 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec1f1935-49ce-4ffa-bce3-f3feee463abd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:22.526329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec1f1935-49ce-4ffa-bce3-f3feee463abd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:22.527126 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec1f1935-49ce-4ffa-bce3-f3feee463abd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:22.527597 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec1f1935-49ce-4ffa-bce3-f3feee463abd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:22.528027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec1f1935-49ce-4ffa-bce3-f3feee463abd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:22.586171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ec1f1935-49ce-4ffa-bce3-f3feee463abd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086156 Aug 09 11:34:22.588004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 427/848] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:34:22 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:34:22.677127 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:22.677959 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:22.686327 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:22.687050 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:22.688378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:22.689327 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:22.689966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:22.690586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:22.740506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:34:22.866955 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-00c2a578-3991-460e-a10f-43618584873a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 204 len: 0 microversion: 2.1 time: 0.193425 Aug 09 11:34:22.867984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 422/849] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:34:22 2022] DELETE /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:34:22.878144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:22.879096 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:22.887273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:22.888246 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:22.888902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:22.889959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:22.891705 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:22.895695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:23.040466 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:23.050367 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-777d1237-492e-4b50-b085-369be1c827d6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1680 microversion: 2.1 time: 0.176817 Aug 09 11:34:23.051053 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 428/850] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:22 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:23.407757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:23.407757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:23.413838 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:23.414347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:23.414775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:23.415800 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:23.416246 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:23.416682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:23.483703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:23.492253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:23.493860 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:23.495067 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0c78b858-d777-4272-b556-e13d8c4cba36 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1339 microversion: 2.20 time: 0.093069 Aug 09 11:34:23.495718 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 423/851] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:23 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:34:23.718476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1433066060", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c80e08a-f8a9-4469-a335-5361a8e5ac82"}], "security_groups": [{"name": "tempest-securitygroup--960872467"}], "key_name": "tempest-keypair-2128157752", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:23.820957 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] validate_networks() for [('2c80e08a-f8a9-4469-a335-5361a8e5ac82', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:34:24.071455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:24.072090 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:24.078724 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:24.079239 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:24.079676 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:24.080369 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:24.080820 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:24.081269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:24.338224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:34:24.339461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:34:24.339948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:34:24.340426 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:34:24.340923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:34:24.345306 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:24.351565 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:24.352359 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:24.352976 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:24.353787 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:24.353927 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-584b1ea4-bfa7-4704-9480-6165413864c1 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1680 microversion: 2.1 time: 0.286391 Aug 09 11:34:24.354164 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:24.354576 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:24.354913 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 424/852] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:24 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1680 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:24.379758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Getting quotas for project 001b779aebf8445eba01022c8c9abe19. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:34:24.384250 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Getting quotas for user 0f80c1f4f2d04a9b80ab0c315dfe180d and project 001b779aebf8445eba01022c8c9abe19. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:34:24.395756 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:34:24.398134 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:34:24.448245 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9f3a3187-5904-4f08-8e90-8641ea6083df tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.734082 Aug 09 11:34:24.449279 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 429/853] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:34:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:34:24.461502 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2c17a437-b586-4c9d-a365-c2786e000f86 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:24.462223 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2c17a437-b586-4c9d-a365-c2786e000f86 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:24.519595 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:24.520525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:24.527224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:24.527984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:24.528580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:24.529281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:24.529748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:24.530513 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:24.548707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2c17a437-b586-4c9d-a365-c2786e000f86 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:24.556252 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2c17a437-b586-4c9d-a365-c2786e000f86 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1238 microversion: 2.1 time: 0.099087 Aug 09 11:34:24.556809 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 425/854] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:24 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1238 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:34:24.625069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:24.633582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:24.635311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:24.636419 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d4b93fb1-dd89-47ad-a121-271f6a9d2767 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1339 microversion: 2.20 time: 0.120978 Aug 09 11:34:24.637229 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 430/855] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:24 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1339 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:34:25.376191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:25.376761 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:25.384164 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:25.384899 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:25.385337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:25.386042 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:25.386492 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:25.386948 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:25.577503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:25.578181 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:25.586829 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:25.587607 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:25.588034 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:25.588747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:25.589237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:25.589813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:25.595396 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:25.616922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:25.637643 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6944156e-bce8-4e9f-b58c-075ed851bcdf tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1680 microversion: 2.1 time: 0.264604 Aug 09 11:34:25.638752 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 426/856] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:25 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1680 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:25.668548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:25.669898 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:25.681191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:25.682060 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:25.684777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:25.686891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:25.687515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:25.688135 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:25.987308 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:25.995380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-599e8321-8184-4e6c-8281-db74937b6cd1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1290 microversion: 2.1 time: 0.421722 Aug 09 11:34:25.996635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 431/857] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:25 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1290 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:26.096919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:26.106349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:26.108240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:26.109925 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-71eb2d8f-4e54-4849-a538-306c7cbaecae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1407 microversion: 2.20 time: 0.452094 Aug 09 11:34:26.125227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 427/858] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:25 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:34:26.191381 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-686b8c0a-a7a6-40bd-a195-810a7a74873b req-c9dba7ce-70b4-450d-b9c9-7e5b75e6355a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec43b88-6ed9-493d-8ac7-c9b9833dad9d", "tag": "1e6ec79e-081d-462d-a29f-df7d6f78d422"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:26.203805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-686b8c0a-a7a6-40bd-a195-810a7a74873b req-c9dba7ce-70b4-450d-b9c9-7e5b75e6355a service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:26.204483 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-686b8c0a-a7a6-40bd-a195-810a7a74873b req-c9dba7ce-70b4-450d-b9c9-7e5b75e6355a service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:26.205090 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-686b8c0a-a7a6-40bd-a195-810a7a74873b req-c9dba7ce-70b4-450d-b9c9-7e5b75e6355a service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:26.218759 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-686b8c0a-a7a6-40bd-a195-810a7a74873b req-c9dba7ce-70b4-450d-b9c9-7e5b75e6355a service nova] Creating event network-changed:1e6ec79e-081d-462d-a29f-df7d6f78d422 for instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d on hv-cinder-84989 Aug 09 11:34:26.224273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-686b8c0a-a7a6-40bd-a195-810a7a74873b req-c9dba7ce-70b4-450d-b9c9-7e5b75e6355a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036446 Aug 09 11:34:26.228493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 432/859] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:26.492834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-04b97033-d9c5-451f-8b3e-45056263d0df req-65e56c89-d298-4c43-890e-ce4036e8c3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8788b6bb-2936-4358-9a4d-6322062d8708", "name": "network-vif-deleted", "tag": "cf3dce9c-970d-4a23-9d99-02b2d7c18e0a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:26.517425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-04b97033-d9c5-451f-8b3e-45056263d0df req-65e56c89-d298-4c43-890e-ce4036e8c3ab service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:26.518312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-04b97033-d9c5-451f-8b3e-45056263d0df req-65e56c89-d298-4c43-890e-ce4036e8c3ab service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:26.518996 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-04b97033-d9c5-451f-8b3e-45056263d0df req-65e56c89-d298-4c43-890e-ce4036e8c3ab service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:26.531939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-04b97033-d9c5-451f-8b3e-45056263d0df req-65e56c89-d298-4c43-890e-ce4036e8c3ab service nova] Creating event network-vif-deleted:cf3dce9c-970d-4a23-9d99-02b2d7c18e0a for instance 8788b6bb-2936-4358-9a4d-6322062d8708 on hv-cinder-84989 Aug 09 11:34:26.539897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-04b97033-d9c5-451f-8b3e-45056263d0df req-65e56c89-d298-4c43-890e-ce4036e8c3ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049757 Aug 09 11:34:26.541099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 428/860] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:26.671670 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:26.675032 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:26.686476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:26.687294 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:26.687928 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:26.689188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:26.690308 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:26.690940 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:26.758887 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:26.759385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:26.759823 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:26.760286 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lazy-loading 'fault' on Instance uuid 8788b6bb-2936-4358-9a4d-6322062d8708 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:34:26.834731 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:26.844874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-dd1836c4-0975-47eb-8a10-d1ffaab007e4 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1331 microversion: 2.1 time: 0.184710 Aug 09 11:34:26.845475 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 433/861] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:26 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1331 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:27.019116 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:27.021004 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:27.028757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:27.029653 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:27.030316 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:27.031301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:27.032254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:27.032891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:27.133085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:27.133689 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:27.141379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:27.142243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:27.142886 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:27.143863 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:27.144477 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:27.148681 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:27.183523 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:27.195340 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e62c8368-9138-4b02-8920-4ee5575ea397 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.178193 Aug 09 11:34:27.215748 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 429/862] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:27 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:34:27.288982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:27.297388 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:27.299000 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:27.300266 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f26dd746-7110-4d30-943b-f82a601c952a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1407 microversion: 2.20 time: 0.171816 Aug 09 11:34:27.300818 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 434/863] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:27 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:34:27.866140 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:27.867352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:27.878802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:27.879415 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:27.879935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:27.880812 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:27.881308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:27.881778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:27.915531 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:27.916010 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:27.916434 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:27.916884 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lazy-loading 'fault' on Instance uuid 8788b6bb-2936-4358-9a4d-6322062d8708 {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:34:27.962256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:27.965798 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:27.971858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7b2ec8c7-eddf-46c7-96b5-261abd4a6008 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1331 microversion: 2.1 time: 0.109582 Aug 09 11:34:27.972437 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 430/864] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:27 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:28.222355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:28.223226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:28.232848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:28.233405 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:28.234029 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:28.235137 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:28.235569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:28.236020 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:28.322346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:28.323008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:28.330073 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:28.330555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:28.331009 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:28.331714 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:28.332156 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:28.332571 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:28.387864 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:28.395960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c09e2ab8-a75f-4f8d-834e-8fe3a024802f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.180039 Aug 09 11:34:28.396550 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 435/865] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:28 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:28.475397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:28.483934 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:28.485585 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:28.486698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1e8e1560-e89e-400e-88d4-0c51f8e0722f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1407 microversion: 2.20 time: 0.168414 Aug 09 11:34:28.487297 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 431/866] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:28 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:34:29.000842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:29.002766 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:29.009158 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:29.009650 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:29.010087 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:29.010779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:29.011256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:29.011675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:29.052412 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:29.053760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:29.053760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:29.053760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lazy-loading 'fault' on Instance uuid 8788b6bb-2936-4358-9a4d-6322062d8708 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:34:29.111450 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:29.119806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7cc275d5-6a1a-4859-97a8-aaf994723adc tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 200 len: 1331 microversion: 2.1 time: 0.129828 Aug 09 11:34:29.120390 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 436/867] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:28 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:29.417432 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:29.418701 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:29.430198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:29.431077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:29.431511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:29.432634 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:29.433975 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:29.434764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:29.510390 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:29.511156 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:29.518081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:29.519184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:29.519809 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:29.520571 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:29.521027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:29.521871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:29.745811 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:29.756821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c750c2b6-6911-4a0e-b715-8d679fdda741 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.343708 Aug 09 11:34:29.757486 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 432/868] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:29 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:29.769741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-adee8289-f455-4b5a-9ad7-bcace7b6700f req-4d68d858-b278-47fe-a26f-158bed879167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f087104-5044-4081-8005-b8ccb3e57299", "tag": "176739a8-1344-413c-8634-a1ecb4b7622c"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:29.780000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-adee8289-f455-4b5a-9ad7-bcace7b6700f req-4d68d858-b278-47fe-a26f-158bed879167 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:29.780625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-adee8289-f455-4b5a-9ad7-bcace7b6700f req-4d68d858-b278-47fe-a26f-158bed879167 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:29.781139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-adee8289-f455-4b5a-9ad7-bcace7b6700f req-4d68d858-b278-47fe-a26f-158bed879167 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:29.792940 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-adee8289-f455-4b5a-9ad7-bcace7b6700f req-4d68d858-b278-47fe-a26f-158bed879167 service nova] Creating event network-changed:176739a8-1344-413c-8634-a1ecb4b7622c for instance 2f087104-5044-4081-8005-b8ccb3e57299 on hv-cinder-84989 Aug 09 11:34:29.798535 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:29.799054 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-adee8289-f455-4b5a-9ad7-bcace7b6700f req-4d68d858-b278-47fe-a26f-158bed879167 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039500 Aug 09 11:34:29.800123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 433/869] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:29.807948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:29.809532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:29.810967 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-af4fcdca-98de-404a-a9ee-190824fde723 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1407 microversion: 2.20 time: 0.305824 Aug 09 11:34:29.811529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 437/870] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:29 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:34:30.141211 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:30.142036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:30.148466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:30.148974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:30.149389 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:30.150083 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:30.150538 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:30.150991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:30.164346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 HTTP/1.1 Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:34:30.165958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:34:30.167511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '8788b6bb-2936-4358-9a4d-6322062d8708'} Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:34:30.168347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:34:30.169717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:34:30.171056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:34:30.171056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7a0bfbf9-46bc-4189-98ac-968acb7277ae tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 404 len: 111 microversion: 2.1 time: 0.030551 Aug 09 11:34:30.171056 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 434/871] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:30 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:34:30.178789 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d52611f1-c7df-4039-bf22-09d3c04535d5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '.version_select at 0x7fece23e9f70>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:30.202485 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d52611f1-c7df-4039-bf22-09d3c04535d5 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064405743" status: 202 len: 0 microversion: 2.1 time: 0.029366 Aug 09 11:34:30.203094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 438/872] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 9 11:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064405743 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:34:30.777828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:30.778443 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:30.785534 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:30.786026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:30.786458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:30.787214 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:30.787655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:30.788078 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:30.837543 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:30.838601 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:30.845664 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:30.846149 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:30.846600 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:30.847345 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:30.847799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:30.848222 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:30.962432 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:30.970491 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ec3ab90b-7c57-4fad-8c9f-1bcc3b76bc58 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.196506 Aug 09 11:34:30.971452 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 435/873] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:30 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:30.984510 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3ebdfea3-85fb-47d9-ad25-5d07b04985e7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: .version_select at 0x7fece24980d0>, body: {"keypair": {"name": "tempest-keypair-982234192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFK1AMltY7rj8zje4HySpE3Cc8gRN+La52QdoHLE7TE5iLk7R64QxKq9iWweKeK7HloL6r6tJO9gu2Xgg/nvLPFSP6YMIwLRg/GIl3HpGf35ZiZtKq5h4Jov8+6gWZ1X7A=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:31.000902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-3ebdfea3-85fb-47d9-ad25-5d07b04985e7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:34:31.004812 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-3ebdfea3-85fb-47d9-ad25-5d07b04985e7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for user 8512df3e232c4fd59b7abad4e6e05c9d and project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:34:31.015398 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:31.025348 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:31.027041 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:31.028270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d1761ab6-6c34-4595-bf20-dfd561ad9c77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1407 microversion: 2.20 time: 0.198365 Aug 09 11:34:31.029330 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 439/874] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:30 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:34:31.030366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3ebdfea3-85fb-47d9-ad25-5d07b04985e7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049463 Aug 09 11:34:31.037022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 436/875] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:34:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:31.991322 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:31.991939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:31.998591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:31.999336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:31.999992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:32.000915 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:32.001459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:32.002083 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:32.049332 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:32.054969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:32.055581 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:32.061992 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:32.062858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:32.063503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:32.064266 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:32.064909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:32.065423 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:32.181717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:32.190609 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-98b0568a-833e-4e37-a247-ba48e58c3e9a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.203057 Aug 09 11:34:32.203281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 440/876] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:31 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:32.228409 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:32.237003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:32.239590 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:32.241352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-724d9c2f-5ec6-4b65-9e57-fd5fa7570910 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1407 microversion: 2.20 time: 0.192554 Aug 09 11:34:32.242707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 437/877] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:32 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:34:32.388889 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-703618443", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f40c29ea-3de1-4291-8b2e-116412f586de"}], "security_groups": [{"name": "tempest-securitygroup--1215648380"}], "key_name": "tempest-keypair-982234192", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:32.496107 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] validate_networks() for [('f40c29ea-3de1-4291-8b2e-116412f586de', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:34:32.875758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:34:32.876177 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:34:32.876631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:34:32.877021 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:34:32.877428 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:34:32.890484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:32.891115 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:32.891554 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:32.892634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:32.892764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:32.893178 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:32.909761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:34:32.913764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Getting quotas for user 8512df3e232c4fd59b7abad4e6e05c9d and project 73d1d7152cc64ac1948d1a97b6b63bd2. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:34:32.925423 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:34:32.927800 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:34:32.973936 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e4adfa69-03b1-47e0-bacf-9408e5f2ad26 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.589387 Aug 09 11:34:32.974582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 441/878] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:34:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:34:32.986104 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5d32749d-f176-47fe-90c6-870cd05f6d77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:32.986835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5d32749d-f176-47fe-90c6-870cd05f6d77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:33.046773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5d32749d-f176-47fe-90c6-870cd05f6d77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:33.054274 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5d32749d-f176-47fe-90c6-870cd05f6d77 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1240 microversion: 2.1 time: 0.072549 Aug 09 11:34:33.055117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 438/879] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:32 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:33.213197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:33.213883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:33.220849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:33.221341 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:33.221900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:33.222600 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:33.223067 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:33.223574 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:33.266659 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:33.267353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:33.274671 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:33.275571 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:33.276339 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:33.278639 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:33.279286 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:33.279885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:33.409199 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:33.417000 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5a48a44e-609a-475f-ad5a-cb78fe90ed13 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.208149 Aug 09 11:34:33.417796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 442/880] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:33 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:33.423013 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-03020bbd-040f-49a8-923e-9bf5af517d95 req-b3ac5153-7358-48b4-acaf-1467256d3771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec43b88-6ed9-493d-8ac7-c9b9833dad9d", "name": "network-vif-plugged", "status": "completed", "tag": "1e6ec79e-081d-462d-a29f-df7d6f78d422"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:33.439280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-03020bbd-040f-49a8-923e-9bf5af517d95 req-b3ac5153-7358-48b4-acaf-1467256d3771 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:33.440016 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-03020bbd-040f-49a8-923e-9bf5af517d95 req-b3ac5153-7358-48b4-acaf-1467256d3771 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:33.441153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-03020bbd-040f-49a8-923e-9bf5af517d95 req-b3ac5153-7358-48b4-acaf-1467256d3771 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:33.454476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-03020bbd-040f-49a8-923e-9bf5af517d95 req-b3ac5153-7358-48b4-acaf-1467256d3771 service nova] Creating event network-vif-plugged:1e6ec79e-081d-462d-a29f-df7d6f78d422 for instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d on hv-cinder-84989 Aug 09 11:34:33.460124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-03020bbd-040f-49a8-923e-9bf5af517d95 req-b3ac5153-7358-48b4-acaf-1467256d3771 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040680 Aug 09 11:34:33.460749 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 443/881] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:33.475347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:33.484141 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:33.485851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:33.487344 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-525df517-226a-467f-8ab0-8c4b41098bd8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1407 microversion: 2.20 time: 0.225892 Aug 09 11:34:33.487966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 439/882] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:33 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:34:34.075844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:34.076476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:34.083397 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:34.083878 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:34.084304 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:34.084990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:34.085435 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:34.085852 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:34.147229 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:34.154777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fba2029d-b256-4603-a952-da941a052b85 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1292 microversion: 2.1 time: 0.083254 Aug 09 11:34:34.155394 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 444/883] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:34 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:34.437838 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:34.438530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:34.445129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:34.445611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:34.446073 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:34.446790 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:34.447266 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:34.447678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:34.509808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:34.510426 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:34.517064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:34.517552 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:34.517989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:34.518684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:34.519137 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:34.519563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:34.630320 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:34.640397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3b1c4147-d036-4500-8d42-fb5ca0e8f9af tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.206497 Aug 09 11:34:34.640990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 440/884] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:34 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:34.678186 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:34.686298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:34.687944 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:34.689036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9090041b-6007-4c6b-b22c-1734fdefe531 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1407 microversion: 2.20 time: 0.183242 Aug 09 11:34:34.689596 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 445/885] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:34 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:34:35.175864 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:35.176465 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:35.183951 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:35.184446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:35.184891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:35.185597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:35.186049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:35.186475 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:35.247696 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:35.255758 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1880353e-ad17-41a2-ae54-9cd9b289be59 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1298 microversion: 2.1 time: 0.083942 Aug 09 11:34:35.256409 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 441/886] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:35 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:35.661848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:35.662461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:35.669866 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:35.670345 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:35.670780 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:35.671547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:35.672313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:35.672747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:35.711750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:35.712360 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:35.719397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:35.720287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:35.720917 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:35.721656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:35.722278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:35.722911 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:35.867225 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:35.883249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:35.885786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:35.887506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e8772474-b4e0-441f-9654-60283a27fbf3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1599 microversion: 2.20 time: 0.180085 Aug 09 11:34:35.888610 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 442/887] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:34:35 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1599 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:34:35.910057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3713a23c-aead-4f29-b618-523e6c4705c6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:35.910880 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3713a23c-aead-4f29-b618-523e6c4705c6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:35.917377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3713a23c-aead-4f29-b618-523e6c4705c6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:35.918107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3713a23c-aead-4f29-b618-523e6c4705c6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:35.918708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3713a23c-aead-4f29-b618-523e6c4705c6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:35.919616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3713a23c-aead-4f29-b618-523e6c4705c6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:35.920231 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3713a23c-aead-4f29-b618-523e6c4705c6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:35.920808 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3713a23c-aead-4f29-b618-523e6c4705c6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:36.067110 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3713a23c-aead-4f29-b618-523e6c4705c6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.161066 Aug 09 11:34:36.071773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 443/888] 10.222.0.59 () {60 vars in 1316 bytes} [Tue Aug 9 11:34:35 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 11:34:36.084234 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:36.093060 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-408f6da4-091e-45fc-8a1f-47af7f04c83c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.435067 Aug 09 11:34:36.098923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 446/889] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:35 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:36.276793 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:36.277468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:36.283772 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:36.284257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:36.284686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:36.285388 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:36.285834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:36.286253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:36.425196 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:36.433074 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e948465d-258f-4264-a692-ff504234364a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.160350 Aug 09 11:34:36.433637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 444/890] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:36 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:37.113831 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:37.114470 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:37.121617 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:37.122669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:37.122669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:37.123655 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:37.124242 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:37.124810 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:37.269133 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:37.277679 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5560c78b-0386-42eb-8163-5d71c54766ee tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.167811 Aug 09 11:34:37.278315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 447/891] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:37 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:37.358583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-5b0e0cf0-2db7-4294-af9f-44092f354ca3 req-7518e90c-1baf-4b24-a252-c6f5673a8f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f087104-5044-4081-8005-b8ccb3e57299", "name": "network-vif-plugged", "status": "completed", "tag": "176739a8-1344-413c-8634-a1ecb4b7622c"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:37.369541 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5b0e0cf0-2db7-4294-af9f-44092f354ca3 req-7518e90c-1baf-4b24-a252-c6f5673a8f9b service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:37.370029 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5b0e0cf0-2db7-4294-af9f-44092f354ca3 req-7518e90c-1baf-4b24-a252-c6f5673a8f9b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:37.370457 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5b0e0cf0-2db7-4294-af9f-44092f354ca3 req-7518e90c-1baf-4b24-a252-c6f5673a8f9b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:37.383709 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-5b0e0cf0-2db7-4294-af9f-44092f354ca3 req-7518e90c-1baf-4b24-a252-c6f5673a8f9b service nova] Creating event network-vif-plugged:176739a8-1344-413c-8634-a1ecb4b7622c for instance 2f087104-5044-4081-8005-b8ccb3e57299 on hv-cinder-84989 Aug 09 11:34:37.389168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-5b0e0cf0-2db7-4294-af9f-44092f354ca3 req-7518e90c-1baf-4b24-a252-c6f5673a8f9b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034753 Aug 09 11:34:37.389719 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 445/892] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:34:37.458320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:37.458837 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:37.470848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:37.471542 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:37.472023 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:37.472927 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:37.473810 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:37.474243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:37.576600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-5481578b-9fda-4f07-9155-65a89be764aa req-50d3a708-ace8-495e-ab03-a7e8f02bb16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18a1571-7069-491b-84ab-b71514f7249e", "tag": "ce00a8ad-98b4-4da5-87ea-b67c75ad2f3a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:37.588696 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5481578b-9fda-4f07-9155-65a89be764aa req-50d3a708-ace8-495e-ab03-a7e8f02bb16b service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:37.589515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5481578b-9fda-4f07-9155-65a89be764aa req-50d3a708-ace8-495e-ab03-a7e8f02bb16b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:37.590154 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-5481578b-9fda-4f07-9155-65a89be764aa req-50d3a708-ace8-495e-ab03-a7e8f02bb16b service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:37.604031 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-5481578b-9fda-4f07-9155-65a89be764aa req-50d3a708-ace8-495e-ab03-a7e8f02bb16b service nova] Creating event network-changed:ce00a8ad-98b4-4da5-87ea-b67c75ad2f3a for instance b18a1571-7069-491b-84ab-b71514f7249e on hv-cinder-84989 Aug 09 11:34:37.609831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-5481578b-9fda-4f07-9155-65a89be764aa req-50d3a708-ace8-495e-ab03-a7e8f02bb16b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037678 Aug 09 11:34:37.611041 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 446/893] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:34:37.616994 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:37.625344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91adcc90-4726-4485-ac8f-49214e6d0177 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.171414 Aug 09 11:34:37.626853 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 448/894] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:37 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:38.299744 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:38.300622 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:38.307673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:38.308177 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:38.308607 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:38.309634 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:38.309759 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:38.310373 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:38.455362 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:38.463664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9f3ea25e-dc9a-4d28-90be-3209d08fa8a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.168187 Aug 09 11:34:38.464238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 447/895] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:38 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:38.648679 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:38.650676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:38.659546 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:38.660039 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:38.660465 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:38.661182 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:38.661618 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:38.662248 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:38.793134 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:38.801265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-81b3891a-7320-4f45-9060-a5ebb4b3615c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.159097 Aug 09 11:34:38.801895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 449/896] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:38 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:39.484949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:39.485540 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:39.492645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:39.493124 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:39.493554 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:39.494248 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:39.494701 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:39.495136 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:39.628022 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-3662abe4-6e05-455e-b8ef-d2cffd07a7f2 req-3bc3753c-4a59-43be-953b-d2f407ec43b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec43b88-6ed9-493d-8ac7-c9b9833dad9d", "tag": "1e6ec79e-081d-462d-a29f-df7d6f78d422"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:39.638144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3662abe4-6e05-455e-b8ef-d2cffd07a7f2 req-3bc3753c-4a59-43be-953b-d2f407ec43b4 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:39.638632 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3662abe4-6e05-455e-b8ef-d2cffd07a7f2 req-3bc3753c-4a59-43be-953b-d2f407ec43b4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:39.639103 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3662abe4-6e05-455e-b8ef-d2cffd07a7f2 req-3bc3753c-4a59-43be-953b-d2f407ec43b4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:39.643148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:39.648292 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:39.651870 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-3662abe4-6e05-455e-b8ef-d2cffd07a7f2 req-3bc3753c-4a59-43be-953b-d2f407ec43b4 service nova] Creating event network-changed:1e6ec79e-081d-462d-a29f-df7d6f78d422 for instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d on hv-cinder-84989 Aug 09 11:34:39.656049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d023b599-ba34-4716-80f1-05bf4294c3e9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.175060 Aug 09 11:34:39.656611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 448/897] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:39 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:39.656757 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-3662abe4-6e05-455e-b8ef-d2cffd07a7f2 req-3bc3753c-4a59-43be-953b-d2f407ec43b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032542 Aug 09 11:34:39.657395 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 450/898] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:39.822186 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:39.822786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:39.829586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:39.830069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:39.830484 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:39.831206 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:39.831650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:39.832063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:39.973173 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:39.980771 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-68d18a89-ad1c-4c3e-bebe-0ecc28769759 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.162583 Aug 09 11:34:39.981370 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 449/899] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:39 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:40.681905 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:40.682495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:40.689516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:40.690000 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:40.690428 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:40.691141 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:40.691610 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:40.692035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:40.825959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:40.834159 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-498bfe1a-e10e-4aac-829b-d10c916073ff tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1363 microversion: 2.1 time: 0.156790 Aug 09 11:34:40.834729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 451/900] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:40 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:41.001658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:41.002220 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:41.011539 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:41.012288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:41.013065 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:41.014189 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:41.014973 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:41.015736 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:41.161776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:41.169937 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0141c9f7-5778-44ae-9a4a-6d29ff0fd8fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.172201 Aug 09 11:34:41.170515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 450/901] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:40 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:41.855251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:41.855833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:41.858374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:41.864221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:41.864675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:41.865129 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:41.865817 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:41.866275 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:41.866685 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:42.010634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:42.019763 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e519b5d9-ed13-4010-8006-b541908aac39 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1548 microversion: 2.1 time: 0.168457 Aug 09 11:34:42.020327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 452/902] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:41 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:42.040337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-304682af-c0c2-4564-a3bb-14aa6e0b4e2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:42.040852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-304682af-c0c2-4564-a3bb-14aa6e0b4e2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:42.047531 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-304682af-c0c2-4564-a3bb-14aa6e0b4e2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:42.048015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-304682af-c0c2-4564-a3bb-14aa6e0b4e2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:42.048447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-304682af-c0c2-4564-a3bb-14aa6e0b4e2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:42.049139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-304682af-c0c2-4564-a3bb-14aa6e0b4e2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:42.049670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-304682af-c0c2-4564-a3bb-14aa6e0b4e2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:42.050096 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-304682af-c0c2-4564-a3bb-14aa6e0b4e2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:42.146598 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-304682af-c0c2-4564-a3bb-14aa6e0b4e2d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110073 Aug 09 11:34:42.147672 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 451/903] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 11:34:42 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:42.197714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:42.198329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:42.204811 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:42.205320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:42.205747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:42.206690 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:42.207702 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:42.208374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:42.552055 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:42.561226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ae369542-ff46-4436-90c7-9279c70507b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.367381 Aug 09 11:34:42.562638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 453/904] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:42 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:43.578741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=16 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:43.583493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:43.584079 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:43.590955 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:43.591432 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:43.591862 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:43.592544 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:43.592973 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:43.593391 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:43.805397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:43.809226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:43.814515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fb924af7-67d0-4331-856a-2cfaecc7b187 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.236926 Aug 09 11:34:43.827278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 452/905] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:43 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:43.849911 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-1a72afec-2d15-4f3c-820d-5e76250a60c6 req-19872f2b-f330-43dd-b7bd-e260831cef22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f087104-5044-4081-8005-b8ccb3e57299", "tag": "176739a8-1344-413c-8634-a1ecb4b7622c"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:43.854946 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:43.855669 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=20 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:34:43.861998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-1a72afec-2d15-4f3c-820d-5e76250a60c6 req-19872f2b-f330-43dd-b7bd-e260831cef22 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:43.862550 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-1a72afec-2d15-4f3c-820d-5e76250a60c6 req-19872f2b-f330-43dd-b7bd-e260831cef22 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:43.863091 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-1a72afec-2d15-4f3c-820d-5e76250a60c6 req-19872f2b-f330-43dd-b7bd-e260831cef22 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:43.875300 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-1a72afec-2d15-4f3c-820d-5e76250a60c6 req-19872f2b-f330-43dd-b7bd-e260831cef22 service nova] Creating event network-changed:176739a8-1344-413c-8634-a1ecb4b7622c for instance 2f087104-5044-4081-8005-b8ccb3e57299 on hv-cinder-84989 Aug 09 11:34:43.880260 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-1a72afec-2d15-4f3c-820d-5e76250a60c6 req-19872f2b-f330-43dd-b7bd-e260831cef22 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034094 Aug 09 11:34:43.881050 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 454/906] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:44.836680 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:44.837275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:44.844783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:44.845267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:44.845679 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:44.846365 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:44.846842 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:44.847253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:44.978792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:44.986845 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-32946a57-e1db-480c-a429-702adabc58ec tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.154427 Aug 09 11:34:44.987586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 453/907] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:44 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:45.395223 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-4cf34007-6682-4804-a4b7-7cb04fbed68f req-156b96ad-b9d5-4a06-8562-4a46457f77d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18a1571-7069-491b-84ab-b71514f7249e", "name": "network-vif-plugged", "status": "completed", "tag": "ce00a8ad-98b4-4da5-87ea-b67c75ad2f3a"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:45.406553 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-4cf34007-6682-4804-a4b7-7cb04fbed68f req-156b96ad-b9d5-4a06-8562-4a46457f77d7 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:45.407064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-4cf34007-6682-4804-a4b7-7cb04fbed68f req-156b96ad-b9d5-4a06-8562-4a46457f77d7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:45.407498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-4cf34007-6682-4804-a4b7-7cb04fbed68f req-156b96ad-b9d5-4a06-8562-4a46457f77d7 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:45.418907 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-4cf34007-6682-4804-a4b7-7cb04fbed68f req-156b96ad-b9d5-4a06-8562-4a46457f77d7 service nova] Creating event network-vif-plugged:ce00a8ad-98b4-4da5-87ea-b67c75ad2f3a for instance b18a1571-7069-491b-84ab-b71514f7249e on hv-cinder-84989 Aug 09 11:34:45.423924 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-4cf34007-6682-4804-a4b7-7cb04fbed68f req-156b96ad-b9d5-4a06-8562-4a46457f77d7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033391 Aug 09 11:34:45.424528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 455/908] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:46.009956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:46.010514 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:46.017454 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:46.017909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:46.018353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:46.019077 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:46.019521 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:46.019935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:46.152753 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:46.160800 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-50c66f67-19f3-4f23-95b1-75b2596a1e47 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.154847 Aug 09 11:34:46.161356 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 454/909] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:46 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:47.182438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:47.183069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:47.189385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:47.189928 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:47.190303 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:47.191026 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:47.191488 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:47.191914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:47.334615 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:47.342674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d2aef975-a1db-4352-8345-47dc3a3b3782 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1366 microversion: 2.1 time: 0.165064 Aug 09 11:34:47.343299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 456/910] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:47 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:48.373979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:48.374584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:48.381778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:48.382254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:48.382682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:48.383406 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:48.383858 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:48.384278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:48.517278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:34:48.525339 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-265fcf1e-3684-4114-99d2-90393e98c027 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1555 microversion: 2.1 time: 0.157760 Aug 09 11:34:48.525895 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 455/911] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:34:48 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:34:48.545216 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6ec0f968-c75b-46cc-9d8f-2f4dd3a94335 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:34:48.545804 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6ec0f968-c75b-46cc-9d8f-2f4dd3a94335 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:34:48.552221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec0f968-c75b-46cc-9d8f-2f4dd3a94335 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:48.552699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec0f968-c75b-46cc-9d8f-2f4dd3a94335 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:48.553122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec0f968-c75b-46cc-9d8f-2f4dd3a94335 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:48.553808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec0f968-c75b-46cc-9d8f-2f4dd3a94335 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:48.554253 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec0f968-c75b-46cc-9d8f-2f4dd3a94335 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:48.554667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ec0f968-c75b-46cc-9d8f-2f4dd3a94335 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:48.639252 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6ec0f968-c75b-46cc-9d8f-2f4dd3a94335 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097515 Aug 09 11:34:48.640202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 457/912] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 11:34:48 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:34:49.604095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-746c3bc2-cb13-45d0-b043-a6ca7c1523e4 req-22bd94a2-b145-48f2-a495-d6c69a569cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18a1571-7069-491b-84ab-b71514f7249e", "tag": "ce00a8ad-98b4-4da5-87ea-b67c75ad2f3a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:34:49.614129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-746c3bc2-cb13-45d0-b043-a6ca7c1523e4 req-22bd94a2-b145-48f2-a495-d6c69a569cb2 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:34:49.614599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-746c3bc2-cb13-45d0-b043-a6ca7c1523e4 req-22bd94a2-b145-48f2-a495-d6c69a569cb2 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:34:49.615067 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-746c3bc2-cb13-45d0-b043-a6ca7c1523e4 req-22bd94a2-b145-48f2-a495-d6c69a569cb2 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:34:49.626259 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-746c3bc2-cb13-45d0-b043-a6ca7c1523e4 req-22bd94a2-b145-48f2-a495-d6c69a569cb2 service nova] Creating event network-changed:ce00a8ad-98b4-4da5-87ea-b67c75ad2f3a for instance b18a1571-7069-491b-84ab-b71514f7249e on hv-cinder-84989 Aug 09 11:34:49.632060 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-746c3bc2-cb13-45d0-b043-a6ca7c1523e4 req-22bd94a2-b145-48f2-a495-d6c69a569cb2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031699 Aug 09 11:34:49.632776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 456/913] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:35:26.447271 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=11 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:35:26.448018 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=32 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:35:26.453758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-959065251"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:35:26.454392 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:26.463154 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:26.463641 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:26.464080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:26.464769 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:26.465400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:26.466033 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:26.612992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.network.security_group_api [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Removing security group 6e427f2f-0b31-4a61-b457-c334fd03c48c from port 9ffb71be-7afd-4c7c-a416-58412ef62e56 Aug 09 11:35:27.199812 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a32b3a09-e9f8-4bf4-b4d0-2140a39bce7c tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "POST /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/action" status: 202 len: 0 microversion: 2.1 time: 0.755306 Aug 09 11:35:27.200452 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 458/914] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:35:26 2022] POST /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:35:27.209044 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:35:27.210430 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=20 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:35:27.215559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-ed74c853-100d-427d-9638-1b99c91e1cc9 req-f7f8f9b3-3ba3-4010-9734-011328e129d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8314a6fc-34c4-4aa1-9157-0ecf77cb217d", "tag": "9ffb71be-7afd-4c7c-a416-58412ef62e56"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:35:27.227205 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-ed74c853-100d-427d-9638-1b99c91e1cc9 req-f7f8f9b3-3ba3-4010-9734-011328e129d3 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:27.227723 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-ed74c853-100d-427d-9638-1b99c91e1cc9 req-f7f8f9b3-3ba3-4010-9734-011328e129d3 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:27.228219 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-ed74c853-100d-427d-9638-1b99c91e1cc9 req-f7f8f9b3-3ba3-4010-9734-011328e129d3 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:27.242168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-ed74c853-100d-427d-9638-1b99c91e1cc9 req-f7f8f9b3-3ba3-4010-9734-011328e129d3 service nova] Creating event network-changed:9ffb71be-7afd-4c7c-a416-58412ef62e56 for instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d on hv-cinder-84989 Aug 09 11:35:27.247701 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-ed74c853-100d-427d-9638-1b99c91e1cc9 req-f7f8f9b3-3ba3-4010-9734-011328e129d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042657 Aug 09 11:35:27.248904 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 457/915] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:35:28.571961 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:28.572601 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:28.578928 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:28.579407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:28.579833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:28.580525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:28.581309 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:28.581724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:28.662273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lazy-loading 'services' on Instance uuid 8314a6fc-34c4-4aa1-9157-0ecf77cb217d {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:35:28.735563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-59851637-3d38-498e-83fd-4214662f0437 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments/fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb" status: 202 len: 0 microversion: 2.1 time: 0.168083 Aug 09 11:35:28.736404 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 459/916] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:35:28 2022] DELETE /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments/fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:35:28.745668 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3719bf8d-da3e-460a-8d71-13633478ad31 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:28.748178 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3719bf8d-da3e-460a-8d71-13633478ad31 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:28.756061 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3719bf8d-da3e-460a-8d71-13633478ad31 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:28.756536 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3719bf8d-da3e-460a-8d71-13633478ad31 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:28.756990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3719bf8d-da3e-460a-8d71-13633478ad31 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:28.757847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3719bf8d-da3e-460a-8d71-13633478ad31 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:28.758351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3719bf8d-da3e-460a-8d71-13633478ad31 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:28.758778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3719bf8d-da3e-460a-8d71-13633478ad31 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:28.789744 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3719bf8d-da3e-460a-8d71-13633478ad31 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048957 Aug 09 11:35:28.790647 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 458/917] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:35:28 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:35:29.263908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-a9fb17ba-1359-426e-a354-fa4315e87c9b req-0e2f460c-2e5d-4cb1-942b-777e5329771a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8314a6fc-34c4-4aa1-9157-0ecf77cb217d", "tag": "9ffb71be-7afd-4c7c-a416-58412ef62e56"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:35:29.273952 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a9fb17ba-1359-426e-a354-fa4315e87c9b req-0e2f460c-2e5d-4cb1-942b-777e5329771a service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:29.274310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a9fb17ba-1359-426e-a354-fa4315e87c9b req-0e2f460c-2e5d-4cb1-942b-777e5329771a service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:29.274741 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a9fb17ba-1359-426e-a354-fa4315e87c9b req-0e2f460c-2e5d-4cb1-942b-777e5329771a service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:29.286307 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-a9fb17ba-1359-426e-a354-fa4315e87c9b req-0e2f460c-2e5d-4cb1-942b-777e5329771a service nova] Creating event network-changed:9ffb71be-7afd-4c7c-a416-58412ef62e56 for instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d on hv-cinder-84989 Aug 09 11:35:29.291396 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-a9fb17ba-1359-426e-a354-fa4315e87c9b req-0e2f460c-2e5d-4cb1-942b-777e5329771a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031581 Aug 09 11:35:29.291995 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 460/918] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:35:29.801922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bd9fc5d0-be64-4203-a1d4-dd964d81ac32 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:29.804154 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bd9fc5d0-be64-4203-a1d4-dd964d81ac32 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:29.810566 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd9fc5d0-be64-4203-a1d4-dd964d81ac32 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:29.811082 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd9fc5d0-be64-4203-a1d4-dd964d81ac32 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:29.811509 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd9fc5d0-be64-4203-a1d4-dd964d81ac32 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:29.812280 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd9fc5d0-be64-4203-a1d4-dd964d81ac32 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:29.812740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd9fc5d0-be64-4203-a1d4-dd964d81ac32 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:29.813500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd9fc5d0-be64-4203-a1d4-dd964d81ac32 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:29.845026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bd9fc5d0-be64-4203-a1d4-dd964d81ac32 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047118 Aug 09 11:35:29.846062 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 459/919] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:35:29 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:35:30.861698 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e0bb44a7-283d-481d-968e-981b8fb60765 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:30.864737 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e0bb44a7-283d-481d-968e-981b8fb60765 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:30.872856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0bb44a7-283d-481d-968e-981b8fb60765 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:30.873506 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0bb44a7-283d-481d-968e-981b8fb60765 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:30.873977 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0bb44a7-283d-481d-968e-981b8fb60765 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:30.874676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0bb44a7-283d-481d-968e-981b8fb60765 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:30.875171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0bb44a7-283d-481d-968e-981b8fb60765 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:30.875582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0bb44a7-283d-481d-968e-981b8fb60765 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:30.906371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e0bb44a7-283d-481d-968e-981b8fb60765 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050875 Aug 09 11:35:30.906938 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 461/920] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:35:30 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:35:30.917882 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:30.918434 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:30.924447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:30.924930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:30.925360 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:30.926049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:30.926500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:30.926949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:31.008552 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] HTTP exception thrown: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d is not attached to volume fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Request method failure captured: Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments/fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb HTTP/1.1 Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kWk3z7rk1q9MZX_Tdu1wZT26lRCJQX0ZYvH-CCOXoKRrFbUt2CSnCb7bWWqjOI83dYhgsBBoXopP65K6tUV3Fx-S6iD_EGgxrTOxR1wqxEno57h0F2glc_5Wrs8fJ5NrMlnbdmAiBm9ceeZ33V4f0jO6smlxyQcvMlB1wJw1aMVoGw Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 0a9c360edd3f46a6bc20bcb78b174478 Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestMinimumBasicScenario-2086013088 Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:35:31.011022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0a9c360edd3f46a6bc20bcb78b174478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0a9c360edd3f46a6bc20bcb78b174478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0a9c360edd3f46a6bc20bcb78b174478"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0a9c360edd3f46a6bc20bcb78b174478", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestMinimumBasicScenario-2086013088 Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 0a9c360edd3f46a6bc20bcb78b174478 Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2086013088 Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-TestMinimumBasicScenario-2086013088-project Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 443ee5d3b542498a8aa78716287f5d83 Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestMinimumBasicScenario-2086013088-project Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:35:31.012686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d is not attached to volume fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'server_id': '8314a6fc-34c4-4aa1-9157-0ecf77cb217d', 'id': 'fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb'} Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb. Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:35:31.013885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d is not attached to volume fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d is not attached to volume fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:31.015493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Returning 404 to user: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d is not attached to volume fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:35:31.016833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9b3afebf-f611-44cf-9caf-887302d64f90 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments/fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb" status: 404 len: 154 microversion: 2.1 time: 0.098866 Aug 09 11:35:31.016833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 460/921] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:35:30 2022] DELETE /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d/os-volume_attachments/fd9d6e7f-4ed1-4d17-a6cc-2ef7c60d88cb => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:35:32.183308 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:32.183853 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:32.192331 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:32.192997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:32.193439 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:32.194142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:32.194602 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:32.195067 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:32.221040 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:35:32.304543 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8baf4595-6b33-4699-a8b7-8c4cb11c0bc7 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 204 len: 0 microversion: 2.1 time: 0.124749 Aug 09 11:35:32.305142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 462/922] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:35:32 2022] DELETE /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:35:32.314682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:32.315332 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:32.322571 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:32.323092 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:32.323532 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:32.324235 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:32.324692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:32.325149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:32.478458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:35:32.486545 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-22378909-4be6-4b2a-8e3d-05aeea6f6efb tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1555 microversion: 2.1 time: 0.175848 Aug 09 11:35:32.487149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 461/923] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:35:32 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:35:33.514628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:33.515360 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:33.522237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:33.522727 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:33.523210 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:33.523909 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:33.524371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:33.524797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:33.665494 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:35:33.674687 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ee8b2368-32c0-4d27-9868-b5aa281a3961 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1555 microversion: 2.1 time: 0.166823 Aug 09 11:35:33.675283 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 463/924] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:35:33 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:35:34.703521 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:34.704082 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:34.711275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:34.711762 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:34.712199 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:34.712900 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:34.713354 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:34.713783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:34.926469 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443ee5d3b542498a8aa78716287f5d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9c360edd3f46a6bc20bcb78b174478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:35:34.934394 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7c77c242-0ba3-41ec-a9b2-1fcdeac81415 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 200 len: 1555 microversion: 2.1 time: 0.234829 Aug 09 11:35:34.935026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 462/925] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:35:34 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:35:35.141634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-26916a28-fb8c-4b8a-b3d6-ac4f3bd65895 req-f739813b-7bd4-4f4b-b5b8-ca5611e079e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8314a6fc-34c4-4aa1-9157-0ecf77cb217d", "name": "network-vif-deleted", "tag": "9ffb71be-7afd-4c7c-a416-58412ef62e56"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:35:35.151840 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-26916a28-fb8c-4b8a-b3d6-ac4f3bd65895 req-f739813b-7bd4-4f4b-b5b8-ca5611e079e2 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:35.152312 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-26916a28-fb8c-4b8a-b3d6-ac4f3bd65895 req-f739813b-7bd4-4f4b-b5b8-ca5611e079e2 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:35.152735 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-26916a28-fb8c-4b8a-b3d6-ac4f3bd65895 req-f739813b-7bd4-4f4b-b5b8-ca5611e079e2 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:35.163841 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-26916a28-fb8c-4b8a-b3d6-ac4f3bd65895 req-f739813b-7bd4-4f4b-b5b8-ca5611e079e2 service nova] Creating event network-vif-deleted:9ffb71be-7afd-4c7c-a416-58412ef62e56 for instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d on hv-cinder-84989 Aug 09 11:35:35.168607 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-26916a28-fb8c-4b8a-b3d6-ac4f3bd65895 req-f739813b-7bd4-4f4b-b5b8-ca5611e079e2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030695 Aug 09 11:35:35.169231 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 464/926] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:35:35.967655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:35.968536 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] [instance: 8314a6fc-34c4-4aa1-9157-0ecf77cb217d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:35:35.977123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:35.977595 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:35.978049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:35.978734 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:35:35.979218 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:35:35.979650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:35:35.993356 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] HTTP exception thrown: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d could not be found. Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Request method failure captured: Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d HTTP/1.1 Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kWk3z7rk1q9MZX_Tdu1wZT26lRCJQX0ZYvH-CCOXoKRrFbUt2CSnCb7bWWqjOI83dYhgsBBoXopP65K6tUV3Fx-S6iD_EGgxrTOxR1wqxEno57h0F2glc_5Wrs8fJ5NrMlnbdmAiBm9ceeZ33V4f0jO6smlxyQcvMlB1wJw1aMVoGw Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 0a9c360edd3f46a6bc20bcb78b174478 Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestMinimumBasicScenario-2086013088 Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:35:35.994897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0a9c360edd3f46a6bc20bcb78b174478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0a9c360edd3f46a6bc20bcb78b174478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0a9c360edd3f46a6bc20bcb78b174478"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0a9c360edd3f46a6bc20bcb78b174478", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestMinimumBasicScenario-2086013088 Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 0a9c360edd3f46a6bc20bcb78b174478 Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2086013088 Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-TestMinimumBasicScenario-2086013088-project Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 443ee5d3b542498a8aa78716287f5d83 Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestMinimumBasicScenario-2086013088-project Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d could not be found. Aug 09 11:35:35.996466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '8314a6fc-34c4-4aa1-9157-0ecf77cb217d'} Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d could not be found. Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:35:35.997288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d could not be found. Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d could not be found. Aug 09 11:35:35.998678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:35:35.999912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Returning 404 to user: Instance 8314a6fc-34c4-4aa1-9157-0ecf77cb217d could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:35:35.999912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e4f57265-de4b-49b8-b862-fba2e2b039b8 tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d" status: 404 len: 111 microversion: 2.1 time: 0.034993 Aug 09 11:35:35.999912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 463/927] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:35:35 2022] GET /compute/v2.1/servers/8314a6fc-34c4-4aa1-9157-0ecf77cb217d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:35:36.006006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-65edd127-0ec2-483a-88ca-d6c29e154cdf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] Calling method '.version_select at 0x7fece6e7f700>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:35:36.028078 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-65edd127-0ec2-483a-88ca-d6c29e154cdf tempest-TestMinimumBasicScenario-2086013088 tempest-TestMinimumBasicScenario-2086013088-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1525815280" status: 202 len: 0 microversion: 2.1 time: 0.026246 Aug 09 11:35:36.028650 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 465/928] 10.222.0.59 () {58 vars in 1272 bytes} [Tue Aug 9 11:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1525815280 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:36:07.565867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e9b1d1cf-bce4-4be1-b2fc-82ea0a52d977 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:07.566503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e9b1d1cf-bce4-4be1-b2fc-82ea0a52d977 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:07.568704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=14 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:07.569435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=34 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:07.575814 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9b1d1cf-bce4-4be1-b2fc-82ea0a52d977 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:07.576298 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9b1d1cf-bce4-4be1-b2fc-82ea0a52d977 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:07.576739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9b1d1cf-bce4-4be1-b2fc-82ea0a52d977 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:07.577440 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9b1d1cf-bce4-4be1-b2fc-82ea0a52d977 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:07.577892 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9b1d1cf-bce4-4be1-b2fc-82ea0a52d977 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:07.578311 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e9b1d1cf-bce4-4be1-b2fc-82ea0a52d977 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:07.603053 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e9b1d1cf-bce4-4be1-b2fc-82ea0a52d977 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/ips" status: 200 len: 152 microversion: 2.20 time: 0.043084 Aug 09 11:36:07.603665 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 464/929] 10.222.0.59 () {60 vars in 1289 bytes} [Tue Aug 9 11:36:07 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:36:07.873281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:07.874386 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:07.878605 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e206cf61-e2f8-450c-92b2-1a4ad9a31042 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:07.879235 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e206cf61-e2f8-450c-92b2-1a4ad9a31042 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:07.890781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e206cf61-e2f8-450c-92b2-1a4ad9a31042 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:07.890781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e206cf61-e2f8-450c-92b2-1a4ad9a31042 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:07.891057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e206cf61-e2f8-450c-92b2-1a4ad9a31042 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:07.891733 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e206cf61-e2f8-450c-92b2-1a4ad9a31042 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:07.892434 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e206cf61-e2f8-450c-92b2-1a4ad9a31042 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:07.892828 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e206cf61-e2f8-450c-92b2-1a4ad9a31042 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:07.918402 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e206cf61-e2f8-450c-92b2-1a4ad9a31042 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/ips" status: 200 len: 149 microversion: 2.1 time: 0.046322 Aug 09 11:36:07.918648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 466/930] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:36:07 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:09.456392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:09.457057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:09.463917 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:09.464537 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:09.464995 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:09.465700 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:09.466139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:09.466574 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:09.490431 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lazy-loading 'flavor' on Instance uuid dec43b88-6ed9-493d-8ac7-c9b9833dad9d {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:36:09.941036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8aacbed6-6eb5-4840-8bba-429f5d792519 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/action" status: 202 len: 0 microversion: 2.20 time: 0.489816 Aug 09 11:36:09.941623 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 465/931] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 9 11:36:09 2022] POST /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:36:09.951204 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:09.951831 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:09.959336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:09.959819 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:09.960262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:09.960969 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:09.961414 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:09.961828 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:10.223312 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:10.231861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:10.233366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:10.234531 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8f71eed8-d8f0-4fc8-a5f0-b656a0cc66ea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.287220 Aug 09 11:36:10.235125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 467/932] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:09 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:36:10.339730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f0fc8512-d67f-4abf-a7bb-c2cb006ef1ba tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b3aeaaa-9fb2-4332-a532-5ef0dcb75de5"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:10.342122 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f0fc8512-d67f-4abf-a7bb-c2cb006ef1ba tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:10.348757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0fc8512-d67f-4abf-a7bb-c2cb006ef1ba tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:10.349241 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0fc8512-d67f-4abf-a7bb-c2cb006ef1ba tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:10.349670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0fc8512-d67f-4abf-a7bb-c2cb006ef1ba tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:10.350358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0fc8512-d67f-4abf-a7bb-c2cb006ef1ba tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:10.350807 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0fc8512-d67f-4abf-a7bb-c2cb006ef1ba tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:10.351264 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f0fc8512-d67f-4abf-a7bb-c2cb006ef1ba tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:10.628838 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f0fc8512-d67f-4abf-a7bb-c2cb006ef1ba tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "POST /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293448 Aug 09 11:36:10.629477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 466/933] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:36:10 2022] POST /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:10.679687 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d732a67c-7f8c-4564-8aa3-05ac36ce06cd tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:10.680209 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d732a67c-7f8c-4564-8aa3-05ac36ce06cd tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:10.686490 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d732a67c-7f8c-4564-8aa3-05ac36ce06cd tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:10.687016 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d732a67c-7f8c-4564-8aa3-05ac36ce06cd tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:10.687501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d732a67c-7f8c-4564-8aa3-05ac36ce06cd tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:10.688113 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d732a67c-7f8c-4564-8aa3-05ac36ce06cd tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:10.688571 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d732a67c-7f8c-4564-8aa3-05ac36ce06cd tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:10.689107 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d732a67c-7f8c-4564-8aa3-05ac36ce06cd tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:10.712703 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d732a67c-7f8c-4564-8aa3-05ac36ce06cd tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/ips" status: 200 len: 145 microversion: 2.1 time: 0.036819 Aug 09 11:36:10.713279 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 468/934] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 11:36:10 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:11.268397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:11.269105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:11.275642 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:11.276140 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:11.276554 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:11.277254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:11.277704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:11.278129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:11.412431 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:11.420694 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:11.422202 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:11.423402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-75883b56-b3ff-4462-bd52-130f3d7be26c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.159993 Aug 09 11:36:11.423961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 467/935] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:11 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:12.072034 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2dbd9be5-8168-4dca-8a30-d1fad370ca8a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f090f9ca-8eac-4319-98ba-981a71e7bec8"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:12.074535 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2dbd9be5-8168-4dca-8a30-d1fad370ca8a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:12.082955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2dbd9be5-8168-4dca-8a30-d1fad370ca8a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:12.083453 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2dbd9be5-8168-4dca-8a30-d1fad370ca8a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:12.083890 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2dbd9be5-8168-4dca-8a30-d1fad370ca8a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:12.084606 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2dbd9be5-8168-4dca-8a30-d1fad370ca8a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:12.085064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2dbd9be5-8168-4dca-8a30-d1fad370ca8a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:12.085490 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2dbd9be5-8168-4dca-8a30-d1fad370ca8a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:12.380759 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2dbd9be5-8168-4dca-8a30-d1fad370ca8a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313290 Aug 09 11:36:12.381365 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 469/936] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:36:12 2022] POST /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:12.456125 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:12.457262 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:12.466449 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:12.467074 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:12.467821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:12.468798 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:12.469430 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:12.469991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:12.880784 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:12.889562 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:12.891115 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:12.892311 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1d0fb792-837c-4a5c-9652-794a376aee2a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.449862 Aug 09 11:36:12.892878 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 468/937] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:12 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:13.918109 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:13.918998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:13.926401 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:13.927130 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:13.927570 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:13.928269 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:13.929132 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:13.930187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:14.088038 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:14.099771 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:14.101282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:14.102661 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-72b00a06-3e35-4207-9bde-8da3adabee0d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.189841 Aug 09 11:36:14.103529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 470/938] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:13 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:15.129017 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:15.130264 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:15.137032 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:15.137508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:15.137934 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:15.138626 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:15.139101 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:15.139516 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:15.276170 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:15.285297 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:15.286792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:15.287993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6190ee01-7744-4001-9932-8c19587f03d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.163038 Aug 09 11:36:15.288521 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 469/939] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:15 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:16.317630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:16.318173 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:16.324884 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:16.325371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:16.325799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:16.326496 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:16.327025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:16.327471 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:16.465529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:16.474587 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:16.476124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:16.477287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-38abc050-78f5-4442-81fd-c648a64db6a2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.163794 Aug 09 11:36:16.477851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 471/940] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:16 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:17.502024 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:17.502681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:17.509705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:17.510194 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:17.510628 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:17.511380 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:17.511834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:17.512262 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:17.660143 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:17.668461 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:17.669888 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:17.671084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-56b0f644-46cc-4bd2-a925-de7758e7654b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.173145 Aug 09 11:36:17.671645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 470/941] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:17 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:18.693917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:18.694591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:18.701655 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:18.702148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:18.702627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:18.703390 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:18.703850 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:18.704277 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:18.853144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:18.861454 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:18.863067 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:18.864246 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d112f6f7-d359-4370-8679-c41c50488ef8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.174429 Aug 09 11:36:18.864806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 472/942] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:18 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:19.363829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:19.364400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:19.371314 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:19.371802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:19.372233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:19.372934 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:19.373390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:19.373818 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:19.457265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lazy-loading 'services' on Instance uuid b18a1571-7069-491b-84ab-b71514f7249e {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:36:19.541368 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-267644f2-4a97-438c-badd-e563b0435175 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments/0b3aeaaa-9fb2-4332-a532-5ef0dcb75de5" status: 202 len: 0 microversion: 2.1 time: 0.182040 Aug 09 11:36:19.541980 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 471/943] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:36:19 2022] DELETE /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments/0b3aeaaa-9fb2-4332-a532-5ef0dcb75de5 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:36:19.550475 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f11770f8-457f-42da-a644-cbbf6fa7c2b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:19.552797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f11770f8-457f-42da-a644-cbbf6fa7c2b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:19.559329 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11770f8-457f-42da-a644-cbbf6fa7c2b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:19.559847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11770f8-457f-42da-a644-cbbf6fa7c2b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:19.560283 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11770f8-457f-42da-a644-cbbf6fa7c2b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:19.561022 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11770f8-457f-42da-a644-cbbf6fa7c2b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:19.561471 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11770f8-457f-42da-a644-cbbf6fa7c2b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:19.561899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f11770f8-457f-42da-a644-cbbf6fa7c2b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:19.594647 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f11770f8-457f-42da-a644-cbbf6fa7c2b0 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048010 Aug 09 11:36:19.595221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 473/944] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:19 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:19.893549 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:19.894161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:19.900599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:19.901099 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:19.901569 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:19.902256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:19.902708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:19.903158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:20.037092 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:20.045567 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:20.047129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:20.048301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0c64c142-579d-4072-aff7-e0743df08b2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.161649 Aug 09 11:36:20.048868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 472/945] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:19 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:20.609240 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2e4a6d0c-e50a-495d-aa66-152916f88b66 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:20.611960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2e4a6d0c-e50a-495d-aa66-152916f88b66 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:20.619305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d0c-e50a-495d-aa66-152916f88b66 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:20.619792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d0c-e50a-495d-aa66-152916f88b66 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:20.620219 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d0c-e50a-495d-aa66-152916f88b66 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:20.620942 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d0c-e50a-495d-aa66-152916f88b66 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:20.621393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d0c-e50a-495d-aa66-152916f88b66 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:20.621813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2e4a6d0c-e50a-495d-aa66-152916f88b66 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:20.652867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2e4a6d0c-e50a-495d-aa66-152916f88b66 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048653 Aug 09 11:36:20.653399 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 474/946] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:20 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:21.072878 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:21.073549 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:21.083982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:21.084670 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:21.085306 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:21.086287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:21.086857 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:21.087472 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:21.225310 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:21.233507 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:21.235057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:21.236224 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5c479203-f4f2-408a-adcf-b74642b892d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.169351 Aug 09 11:36:21.236779 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 473/947] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:21 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:21.666229 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-86783203-a4cd-4590-8166-f11b1293014c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:21.668339 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-86783203-a4cd-4590-8166-f11b1293014c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:21.675248 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86783203-a4cd-4590-8166-f11b1293014c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:21.675733 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86783203-a4cd-4590-8166-f11b1293014c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:21.676170 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86783203-a4cd-4590-8166-f11b1293014c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:21.676866 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86783203-a4cd-4590-8166-f11b1293014c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:21.677319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86783203-a4cd-4590-8166-f11b1293014c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:21.677745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-86783203-a4cd-4590-8166-f11b1293014c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:21.709304 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-86783203-a4cd-4590-8166-f11b1293014c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047216 Aug 09 11:36:21.709863 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 475/948] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:21 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:22.261750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:22.262313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:22.271768 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:22.272570 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:22.273010 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:22.273936 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:22.274509 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:22.275251 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:22.423000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:22.431208 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:22.432699 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:22.433879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-addc8624-b7d2-41bf-b686-e20b4cc3a987 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1745 microversion: 2.20 time: 0.177720 Aug 09 11:36:22.434456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 474/949] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:22 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:22.722425 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fb8dfa70-24b1-4e10-b20a-376230fabcb7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:22.724903 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fb8dfa70-24b1-4e10-b20a-376230fabcb7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:22.732165 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb8dfa70-24b1-4e10-b20a-376230fabcb7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:22.732760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb8dfa70-24b1-4e10-b20a-376230fabcb7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:22.733341 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb8dfa70-24b1-4e10-b20a-376230fabcb7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:22.734058 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb8dfa70-24b1-4e10-b20a-376230fabcb7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:22.734500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb8dfa70-24b1-4e10-b20a-376230fabcb7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:22.734953 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb8dfa70-24b1-4e10-b20a-376230fabcb7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:22.765544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fb8dfa70-24b1-4e10-b20a-376230fabcb7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047322 Aug 09 11:36:22.766117 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 476/950] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:22 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:23.458102 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:23.458694 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:23.465959 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:23.466447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:23.466877 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:23.467610 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:23.468058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:23.468479 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:23.604721 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:23.612829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:23.614315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:23.615512 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-65a35e2c-12cf-4b17-abab-c45ddab1df18 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1745 microversion: 2.20 time: 0.161860 Aug 09 11:36:23.616057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 475/951] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:23 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:23.778506 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5da4d113-aa79-4957-a020-608f380deef7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:23.780720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5da4d113-aa79-4957-a020-608f380deef7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:23.787570 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5da4d113-aa79-4957-a020-608f380deef7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:23.788055 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5da4d113-aa79-4957-a020-608f380deef7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:23.788492 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5da4d113-aa79-4957-a020-608f380deef7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:23.789191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5da4d113-aa79-4957-a020-608f380deef7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:23.789646 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5da4d113-aa79-4957-a020-608f380deef7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:23.790066 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5da4d113-aa79-4957-a020-608f380deef7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:23.820370 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5da4d113-aa79-4957-a020-608f380deef7 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045907 Aug 09 11:36:23.820910 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 477/952] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:23 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:24.637896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:24.638729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:24.645297 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:24.645782 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:24.646215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:24.646942 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:24.647397 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:24.647816 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:24.784496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:24.788088 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:24.793423 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:24.794965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:24.796163 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5d41634a-010d-4b11-af4d-909a9b10c3f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1745 microversion: 2.20 time: 0.162313 Aug 09 11:36:24.797000 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 476/953] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:24 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:24.833464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5afbd1ec-784e-4d66-8d81-2d763865638b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:24.835630 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5afbd1ec-784e-4d66-8d81-2d763865638b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:24.842488 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5afbd1ec-784e-4d66-8d81-2d763865638b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:24.843006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5afbd1ec-784e-4d66-8d81-2d763865638b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:24.843435 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5afbd1ec-784e-4d66-8d81-2d763865638b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:24.844131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5afbd1ec-784e-4d66-8d81-2d763865638b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:24.844583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5afbd1ec-784e-4d66-8d81-2d763865638b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:24.845009 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5afbd1ec-784e-4d66-8d81-2d763865638b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:24.877171 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5afbd1ec-784e-4d66-8d81-2d763865638b tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Aug 09 11:36:24.877723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 478/954] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:24 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:25.819919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:25.820591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:25.828842 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:25.829335 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:25.829809 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:25.830847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:25.831302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:25.831724 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:25.891973 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d9586ef1-ed51-4372-b895-653110751c1e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:25.894636 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d9586ef1-ed51-4372-b895-653110751c1e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:25.901601 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9586ef1-ed51-4372-b895-653110751c1e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:25.902176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9586ef1-ed51-4372-b895-653110751c1e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:25.902740 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9586ef1-ed51-4372-b895-653110751c1e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:25.903721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9586ef1-ed51-4372-b895-653110751c1e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:25.904256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9586ef1-ed51-4372-b895-653110751c1e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:25.904685 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9586ef1-ed51-4372-b895-653110751c1e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:25.935851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d9586ef1-ed51-4372-b895-653110751c1e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048047 Aug 09 11:36:25.937084 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 479/955] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:25 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:25.941801 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e0395704-9c96-4eae-b5e0-0f9ac8da45d1 req-6545f1c6-6232-4710-a5f3-df104de6a8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec43b88-6ed9-493d-8ac7-c9b9833dad9d", "name": "network-vif-plugged", "status": "completed", "tag": "1e6ec79e-081d-462d-a29f-df7d6f78d422"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:25.951601 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e0395704-9c96-4eae-b5e0-0f9ac8da45d1 req-6545f1c6-6232-4710-a5f3-df104de6a8e9 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:25.951988 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e0395704-9c96-4eae-b5e0-0f9ac8da45d1 req-6545f1c6-6232-4710-a5f3-df104de6a8e9 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:25.952411 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e0395704-9c96-4eae-b5e0-0f9ac8da45d1 req-6545f1c6-6232-4710-a5f3-df104de6a8e9 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:25.964332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e0395704-9c96-4eae-b5e0-0f9ac8da45d1 req-6545f1c6-6232-4710-a5f3-df104de6a8e9 service nova] Creating event network-vif-plugged:1e6ec79e-081d-462d-a29f-df7d6f78d422 for instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d on hv-cinder-84989 Aug 09 11:36:25.969578 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e0395704-9c96-4eae-b5e0-0f9ac8da45d1 req-6545f1c6-6232-4710-a5f3-df104de6a8e9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031186 Aug 09 11:36:25.970700 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 480/956] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:25.977787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:25.987383 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:25.988971 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:25.990112 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ec1ee0ac-22ce-4515-9699-093728a69b95 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1745 microversion: 2.20 time: 0.174482 Aug 09 11:36:25.990695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 477/957] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:25 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:26.342070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c2b7f914-48b9-4432-bdba-8c090fa600a3 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:26.344432 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c2b7f914-48b9-4432-bdba-8c090fa600a3 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:26.351030 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2b7f914-48b9-4432-bdba-8c090fa600a3 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:26.351682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2b7f914-48b9-4432-bdba-8c090fa600a3 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:26.352128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2b7f914-48b9-4432-bdba-8c090fa600a3 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:26.352872 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2b7f914-48b9-4432-bdba-8c090fa600a3 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:26.353335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2b7f914-48b9-4432-bdba-8c090fa600a3 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:26.353883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2b7f914-48b9-4432-bdba-8c090fa600a3 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:26.388394 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c2b7f914-48b9-4432-bdba-8c090fa600a3 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050683 Aug 09 11:36:26.389095 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 481/958] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:26 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:26.400992 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-01bfbd6e-2e53-482a-8d76-12641b1406c6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:26.401754 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-01bfbd6e-2e53-482a-8d76-12641b1406c6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:26.408293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01bfbd6e-2e53-482a-8d76-12641b1406c6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:26.409429 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01bfbd6e-2e53-482a-8d76-12641b1406c6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:26.409429 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01bfbd6e-2e53-482a-8d76-12641b1406c6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:26.409969 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01bfbd6e-2e53-482a-8d76-12641b1406c6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:26.410424 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01bfbd6e-2e53-482a-8d76-12641b1406c6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:26.410870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-01bfbd6e-2e53-482a-8d76-12641b1406c6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:26.443471 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-01bfbd6e-2e53-482a-8d76-12641b1406c6 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/f090f9ca-8eac-4319-98ba-981a71e7bec8" status: 200 len: 194 microversion: 2.1 time: 0.047221 Aug 09 11:36:26.444112 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 478/959] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Aug 9 11:36:26 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/f090f9ca-8eac-4319-98ba-981a71e7bec8 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:26.949988 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8b56f65b-b0a3-478d-a08f-aeed41303b8d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:26.952184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8b56f65b-b0a3-478d-a08f-aeed41303b8d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:26.959770 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b56f65b-b0a3-478d-a08f-aeed41303b8d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:26.960255 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b56f65b-b0a3-478d-a08f-aeed41303b8d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:26.960679 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b56f65b-b0a3-478d-a08f-aeed41303b8d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:26.961366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b56f65b-b0a3-478d-a08f-aeed41303b8d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:26.961810 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b56f65b-b0a3-478d-a08f-aeed41303b8d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:26.962226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b56f65b-b0a3-478d-a08f-aeed41303b8d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:26.980167 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:26.993954 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8b56f65b-b0a3-478d-a08f-aeed41303b8d tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047981 Aug 09 11:36:26.994508 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 482/960] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:26 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:36:27.013392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:27.014006 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:27.021195 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:27.021772 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:27.022297 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:27.023036 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:27.023479 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:27.023906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:27.065133 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:27.065623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:27.071811 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:27.072293 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:27.072723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:27.073418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:27.073870 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:27.074291 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:27.099566 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:36:27.170546 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:27.179915 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:27.181885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:27.183591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-adc012b1-a603-4646-a880-6b92e1f23042 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1745 microversion: 2.20 time: 0.174647 Aug 09 11:36:27.184776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 479/961] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:27 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:27.204893 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c70b7105-b81d-48f9-911a-35b579eed5d2 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 204 len: 0 microversion: 2.1 time: 0.143361 Aug 09 11:36:27.205796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 483/962] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:36:27 2022] DELETE /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 11:36:27.215632 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:27.216241 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:27.223410 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:27.224240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:27.224802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:27.225867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:27.226559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:27.227246 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:27.366992 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:27.375981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2869f10b-012a-40d7-8182-534bdbbe636e tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1680 microversion: 2.1 time: 0.165002 Aug 09 11:36:27.376624 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 480/963] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:27 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:36:27.807781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3d389408-95c8-47c4-aa98-c1dc1744db5f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba90dd78-70a0-467f-a4b8-8addb8127be9"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:27.810247 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3d389408-95c8-47c4-aa98-c1dc1744db5f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:27.816430 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d389408-95c8-47c4-aa98-c1dc1744db5f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:27.816918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d389408-95c8-47c4-aa98-c1dc1744db5f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:27.817352 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d389408-95c8-47c4-aa98-c1dc1744db5f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:27.818045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d389408-95c8-47c4-aa98-c1dc1744db5f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:27.818498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d389408-95c8-47c4-aa98-c1dc1744db5f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:27.818955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d389408-95c8-47c4-aa98-c1dc1744db5f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:28.212428 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:28.213084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:28.222742 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:28.223367 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:28.223958 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:28.224656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:28.225115 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:28.225543 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:28.369024 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:28.377424 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:28.378954 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:28.380269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f982cc36-1d86-4275-a0cf-95d656e4ef4f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1740 microversion: 2.20 time: 0.173194 Aug 09 11:36:28.380854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 481/964] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:28 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:28.398215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:28.398843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:28.405234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:28.405756 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:28.406167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:28.406895 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:28.407376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:28.407795 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:28.554777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:28.568684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-158f374c-5d29-418b-966b-31f1f0e1a1c6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1680 microversion: 2.1 time: 0.173944 Aug 09 11:36:28.570321 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 482/965] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:28 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:36:28.693141 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3d389408-95c8-47c4-aa98-c1dc1744db5f tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "POST /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889621 Aug 09 11:36:28.694062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 484/966] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 11:36:27 2022] POST /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:29.408303 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:29.410065 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:29.417400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:29.417981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:29.418661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:29.419611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:29.420272 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:29.420926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:29.595081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:29.596338 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:29.604556 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:29.605053 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:29.605487 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:29.606496 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:29.607186 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:29.607612 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:29.751395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:29.762618 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:29.765446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:29.767098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8861b3a9-a098-4756-999f-10ddaf9d4708 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1740 microversion: 2.20 time: 0.362719 Aug 09 11:36:29.768555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 483/967] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:29 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:29.845828 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:29.855338 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c594aa4a-2dd7-4490-b19a-4f2c6ef3e453 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1680 microversion: 2.1 time: 0.267401 Aug 09 11:36:29.869317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 485/968] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:29 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1680 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:36:30.406303 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-dfdf64af-7d7e-45bf-83a0-e2fb858bade3 req-1e16c14b-e607-4d43-8606-7fd262759b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18a1571-7069-491b-84ab-b71514f7249e", "name": "network-vif-deleted", "tag": "ce00a8ad-98b4-4da5-87ea-b67c75ad2f3a"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:30.423401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-dfdf64af-7d7e-45bf-83a0-e2fb858bade3 req-1e16c14b-e607-4d43-8606-7fd262759b89 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:30.432730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-dfdf64af-7d7e-45bf-83a0-e2fb858bade3 req-1e16c14b-e607-4d43-8606-7fd262759b89 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:30.433222 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-dfdf64af-7d7e-45bf-83a0-e2fb858bade3 req-1e16c14b-e607-4d43-8606-7fd262759b89 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:30.447839 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-dfdf64af-7d7e-45bf-83a0-e2fb858bade3 req-1e16c14b-e607-4d43-8606-7fd262759b89 service nova] Creating event network-vif-deleted:ce00a8ad-98b4-4da5-87ea-b67c75ad2f3a for instance b18a1571-7069-491b-84ab-b71514f7249e on hv-cinder-84989 Aug 09 11:36:30.455713 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-dfdf64af-7d7e-45bf-83a0-e2fb858bade3 req-1e16c14b-e607-4d43-8606-7fd262759b89 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059717 Aug 09 11:36:30.456708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 484/969] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:30.795982 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:30.797655 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:30.806440 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:30.806962 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:30.807500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:30.808268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:30.808725 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:30.809150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:30.876567 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:30.877530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:30.886193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:30.886973 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:30.887597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:30.888649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:30.889380 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:30.889960 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:31.012739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:31.013302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:31.013755 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:31.014209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lazy-loading 'fault' on Instance uuid b18a1571-7069-491b-84ab-b71514f7249e {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:36:31.105210 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:31.106490 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512df3e232c4fd59b7abad4e6e05c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d1d7152cc64ac1948d1a97b6b63bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:31.113667 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3323fa89-a953-4b98-be7b-e5f748cd7515 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 200 len: 1330 microversion: 2.1 time: 0.241474 Aug 09 11:36:31.115851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 485/970] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:30 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 1330 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:36:31.125596 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:31.128293 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:31.129708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-66b7d003-43bc-41b5-9acc-0de339b44031 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1740 microversion: 2.20 time: 0.340703 Aug 09 11:36:31.133350 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 486/971] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:30 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1740 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:32.135192 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:32.136046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:32.144787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:32.145265 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:32.145687 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:32.146439 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:32.146831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:32.147366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:32.156376 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:32.158406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:32.167789 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:32.168382 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:32.168893 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:32.169708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:32.170276 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:32.171032 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:32.176167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e HTTP/1.1 Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:36:32.178095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:32.179827 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'b18a1571-7069-491b-84ab-b71514f7249e'} Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:32.180778 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:32.182392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:32.185469 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:32.187108 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c22e37bc-b7aa-4649-9072-a0fcbf10b71a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 404 len: 111 microversion: 2.1 time: 0.055332 Aug 09 11:36:32.188203 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 486/972] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:32 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:32.196810 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-753aec97-411d-4499-8956-d3de1a610af6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '.version_select at 0x7fece244c670>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:32.223472 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-753aec97-411d-4499-8956-d3de1a610af6 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982234192" status: 202 len: 0 microversion: 2.1 time: 0.030708 Aug 09 11:36:32.224210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 487/973] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Aug 9 11:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982234192 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:36:32.332683 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:32.342860 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:32.344877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:32.346419 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1bd33bb8-5708-48a8-b57b-a06a587207d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1740 microversion: 2.20 time: 0.194133 Aug 09 11:36:32.347531 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 487/974] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:32 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:33.370275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:33.371170 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:33.378351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:33.379240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:33.379733 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:33.380500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:33.381015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:33.382229 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:33.538366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:33.548718 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:33.550679 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:33.552191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7b24220f-0c6b-48de-922e-446da41e491a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1740 microversion: 2.20 time: 0.186512 Aug 09 11:36:33.567845 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 488/975] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:33 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:34.210701 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:34.211437 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:34.219182 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:34.219498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:34.219960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:34.220654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:34.221132 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:34.221570 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:34.236124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e HTTP/1.1 Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:36:34.238093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.239695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': 'b18a1571-7069-491b-84ab-b71514f7249e'} Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:34.240582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.242135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.243595 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:34.243595 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3f741596-9ac9-48c9-a835-c5a306393d6c tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 404 len: 111 microversion: 2.1 time: 0.035663 Aug 09 11:36:34.246954 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 488/976] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:36:34 2022] DELETE /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:34.251216 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:34.252261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: b18a1571-7069-491b-84ab-b71514f7249e] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:34.259337 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:34.259931 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:34.260465 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:34.261267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:34.261945 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:34.262436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:34.277444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e HTTP/1.1 Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:36:34.279160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.280868 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'b18a1571-7069-491b-84ab-b71514f7249e'} Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:34.281602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. Aug 09 11:36:34.283402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:34.285376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance b18a1571-7069-491b-84ab-b71514f7249e could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:34.285376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a37bca7a-977d-4c70-b29b-acedf99107fa tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e" status: 404 len: 111 microversion: 2.1 time: 0.033602 Aug 09 11:36:34.285376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 489/977] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:34 2022] GET /compute/v2.1/servers/b18a1571-7069-491b-84ab-b71514f7249e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:34.578318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:34.578959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:34.585623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:34.586103 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:34.586558 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:34.587253 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:34.587934 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:34.588303 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:34.743748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:34.753569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:34.755247 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:34.756794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1b4e5689-8342-48a8-a0a0-ef62af62a254 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1740 microversion: 2.20 time: 0.182497 Aug 09 11:36:34.757483 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 489/978] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:34 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:35.443619 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:35.444792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:35.454881 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.455735 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.456212 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.457129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.457850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.458442 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.475841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 HTTP/1.1 Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:36:35.478308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.479974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '8788b6bb-2936-4358-9a4d-6322062d8708'} Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:35.480773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.482161 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.485051 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:35.486122 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1d48dbad-7cfc-4fe1-a4c4-9a4fd3016c89 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 404 len: 111 microversion: 2.1 time: 0.048467 Aug 09 11:36:35.486985 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 490/979] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:36:35 2022] DELETE /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:35.495855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:35.497738 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 8788b6bb-2936-4358-9a4d-6322062d8708] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:35.504299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.504779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.505206 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.505899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.506383 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.506801 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.521136 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 HTTP/1.1 Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:36:35.523059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.524507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '8788b6bb-2936-4358-9a4d-6322062d8708'} Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:35.525816 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. Aug 09 11:36:35.527551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.530224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance 8788b6bb-2936-4358-9a4d-6322062d8708 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:35.530224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-15384bb2-6bfb-4082-81fa-a7fbd7292348 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708" status: 404 len: 111 microversion: 2.1 time: 0.032913 Aug 09 11:36:35.530224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 490/980] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:35 2022] GET /compute/v2.1/servers/8788b6bb-2936-4358-9a4d-6322062d8708 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:35.537447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:35.538344 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:35.544709 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.545183 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.545606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.546304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.546755 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.547199 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.566750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 HTTP/1.1 Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:36:35.568678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.570496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'd019a5ec-b564-47a3-a2fa-0970ad1bb2d4'} Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:35.571348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.572577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.573837 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:35.573837 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fcfd1d84-c605-43c5-9b93-e7890ee1c28a tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 404 len: 111 microversion: 2.1 time: 0.040022 Aug 09 11:36:35.574615 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 491/981] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:36:35 2022] DELETE /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:35.584153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:35.584833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: d019a5ec-b564-47a3-a2fa-0970ad1bb2d4] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:35.591149 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.591635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.592210 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.592911 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.593374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.593797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.610429 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 HTTP/1.1 Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:36:35.612044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.613873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': 'd019a5ec-b564-47a3-a2fa-0970ad1bb2d4'} Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:35.614798 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. Aug 09 11:36:35.616668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:35.618978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:35.619842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91b0d3f0-a881-416f-9a96-7f6bed6107fd tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4" status: 404 len: 111 microversion: 2.1 time: 0.042457 Aug 09 11:36:35.620643 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 491/982] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:35 2022] GET /compute/v2.1/servers/d019a5ec-b564-47a3-a2fa-0970ad1bb2d4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:35.785916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:35.786529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:35.792886 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.793360 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.793784 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.794529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:35.795441 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:35.796286 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:35.944946 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:35.953066 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:35.954588 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:35.956107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d5bfddcf-45d6-480d-815e-3bccd676459e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1740 microversion: 2.20 time: 0.180103 Aug 09 11:36:35.956883 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 492/983] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:35 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:36:36.354242 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c72632e4-e657-4650-b73d-3d90ef9710db tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:36.356853 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c72632e4-e657-4650-b73d-3d90ef9710db tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:36.369198 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c72632e4-e657-4650-b73d-3d90ef9710db tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.369682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c72632e4-e657-4650-b73d-3d90ef9710db tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.370116 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c72632e4-e657-4650-b73d-3d90ef9710db tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.370842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c72632e4-e657-4650-b73d-3d90ef9710db tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.371311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c72632e4-e657-4650-b73d-3d90ef9710db tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.371730 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c72632e4-e657-4650-b73d-3d90ef9710db tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.419808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c72632e4-e657-4650-b73d-3d90ef9710db tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.075576 Aug 09 11:36:36.420631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 492/984] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:36 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:36.562879 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4ce214ec-6c57-4611-9c0a-860972290b68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:36.563444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4ce214ec-6c57-4611-9c0a-860972290b68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:36.570426 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce214ec-6c57-4611-9c0a-860972290b68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.571211 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce214ec-6c57-4611-9c0a-860972290b68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.571845 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce214ec-6c57-4611-9c0a-860972290b68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.572544 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce214ec-6c57-4611-9c0a-860972290b68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.573169 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce214ec-6c57-4611-9c0a-860972290b68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.575105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce214ec-6c57-4611-9c0a-860972290b68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.612466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4ce214ec-6c57-4611-9c0a-860972290b68 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/f090f9ca-8eac-4319-98ba-981a71e7bec8" status: 200 len: 194 microversion: 2.1 time: 0.054282 Aug 09 11:36:36.618700 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 493/985] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Aug 9 11:36:36 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/f090f9ca-8eac-4319-98ba-981a71e7bec8 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:36.624187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:36.624929 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:36.633228 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.633721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.634148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.635118 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.635812 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.636196 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.729415 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lazy-loading 'services' on Instance uuid 2f087104-5044-4081-8005-b8ccb3e57299 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:36:36.785995 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:36.787046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:36.797972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.801035 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.801379 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.804118 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.804740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.805299 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.818888 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2846f12e-c250-45a0-a5d6-bc3a2f2d4972 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/f090f9ca-8eac-4319-98ba-981a71e7bec8" status: 202 len: 0 microversion: 2.1 time: 0.197345 Aug 09 11:36:36.820224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 493/986] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:36:36 2022] DELETE /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/f090f9ca-8eac-4319-98ba-981a71e7bec8 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:36:36.828225 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c HTTP/1.1 Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:36:36.834378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.836081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '47718566-e01b-41e5-bdc1-ba691dc04c2c'} Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:36.836979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.838592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.841052 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:36.842211 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a866dfc6-4d4b-4cb5-9046-31d7042c0e18 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "DELETE /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 404 len: 111 microversion: 2.1 time: 0.061347 Aug 09 11:36:36.847085 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 494/987] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:36:36 2022] DELETE /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:36:36.854386 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:36.855143 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] [instance: 47718566-e01b-41e5-bdc1-ba691dc04c2c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:36.868450 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.868953 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.870808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.880749 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:36.885693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:36.886189 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:36.919371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] HTTP exception thrown: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Request method failure captured: Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c HTTP/1.1 Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kRGX4oojueFNnXGDDTJQlw8xn-2jFzRddDJUXNGxiqnJxb5bSRTgmHwQnL34DjuuO-oL2PHtF9Q1yXodKzCbbefSxAuB7WSSdZYXwoOy7P0n6pqOr0-WPw3U8y6rvDbz8xBjba_0qzMoXkEr9dqKp8x-onVVBU4TsAa6HJNsbLndTA Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:36:36.921045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d1d7152cc64ac1948d1a97b6b63bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d1d7152cc64ac1948d1a97b6b63bd2", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 73d1d7152cc64ac1948d1a97b6b63bd2 Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183301441 Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 8512df3e232c4fd59b7abad4e6e05c9d Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1183301441-project Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.922583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '47718566-e01b-41e5-bdc1-ba691dc04c2c'} Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:36.923461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. Aug 09 11:36:36.925153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:36.926401 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] Returning 404 to user: Instance 47718566-e01b-41e5-bdc1-ba691dc04c2c could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:36.926401 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f784181f-011a-4c3f-aa29-6fdbd1654142 tempest-AttachVolumeNegativeTest-1183301441 tempest-AttachVolumeNegativeTest-1183301441-project] 10.222.0.59 "GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c" status: 404 len: 111 microversion: 2.1 time: 0.074773 Aug 09 11:36:36.927556 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 494/988] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:36 2022] GET /compute/v2.1/servers/47718566-e01b-41e5-bdc1-ba691dc04c2c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:36.991272 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:36.992655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:37.002887 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:37.003917 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:37.004538 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:37.005704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:37.006780 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:37.007408 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:37.241335 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:37.252865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:37.254676 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:37.256050 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5297a08c-94cf-4fb8-9118-36352f1174c2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1740 microversion: 2.20 time: 0.278350 Aug 09 11:36:37.256930 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 495/989] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:36 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:38.282655 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:38.283419 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:38.296977 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:38.303646 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:38.307664 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:38.308353 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:38.316530 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:38.317178 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:38.317877 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:38.841782 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:38.851170 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:38.852793 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:38.853999 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-523716ae-3834-47e8-9420-4e80873196e2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1740 microversion: 2.20 time: 0.575817 Aug 09 11:36:38.854648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 495/990] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:38 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1740 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:39.033844 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-30bc8a8d-44c7-4b7e-9e8d-1e0267c55821 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:39.034413 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-30bc8a8d-44c7-4b7e-9e8d-1e0267c55821 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:39.037228 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:39.043395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30bc8a8d-44c7-4b7e-9e8d-1e0267c55821 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:39.043882 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30bc8a8d-44c7-4b7e-9e8d-1e0267c55821 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:39.044308 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30bc8a8d-44c7-4b7e-9e8d-1e0267c55821 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:39.045018 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30bc8a8d-44c7-4b7e-9e8d-1e0267c55821 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:39.045466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30bc8a8d-44c7-4b7e-9e8d-1e0267c55821 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:39.045891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30bc8a8d-44c7-4b7e-9e8d-1e0267c55821 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:39.080516 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-30bc8a8d-44c7-4b7e-9e8d-1e0267c55821 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/ba90dd78-70a0-467f-a4b8-8addb8127be9" status: 200 len: 194 microversion: 2.1 time: 0.050246 Aug 09 11:36:39.081309 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 496/991] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Aug 9 11:36:39 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/ba90dd78-70a0-467f-a4b8-8addb8127be9 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:39.092294 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:39.092866 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:39.099217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:39.099924 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:39.100686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:39.101730 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:39.102367 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:39.102991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:39.207206 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lazy-loading 'services' on Instance uuid 2f087104-5044-4081-8005-b8ccb3e57299 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:36:39.312069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-60df94d6-b041-4678-b321-39bfa47bad23 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/ba90dd78-70a0-467f-a4b8-8addb8127be9" status: 202 len: 0 microversion: 2.1 time: 0.222967 Aug 09 11:36:39.314640 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 496/992] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 11:36:39 2022] DELETE /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments/ba90dd78-70a0-467f-a4b8-8addb8127be9 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 11:36:39.878375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:39.879069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:39.885866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:39.886393 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:39.886923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:39.887664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:39.888148 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:39.888567 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:40.125401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:40.135034 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:40.136845 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:40.138221 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-60e28cc0-db75-4cd2-8249-1b4d59656dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1722 microversion: 2.20 time: 0.264382 Aug 09 11:36:40.139280 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 497/993] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:39 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:40.558532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9196f0dd-2a35-434b-b053-dba533e493a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:40.561078 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9196f0dd-2a35-434b-b053-dba533e493a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:40.573806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9196f0dd-2a35-434b-b053-dba533e493a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:40.574306 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9196f0dd-2a35-434b-b053-dba533e493a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:40.574761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9196f0dd-2a35-434b-b053-dba533e493a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:40.575603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9196f0dd-2a35-434b-b053-dba533e493a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:40.576066 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9196f0dd-2a35-434b-b053-dba533e493a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:40.576491 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9196f0dd-2a35-434b-b053-dba533e493a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:40.599356 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:40.612440 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9196f0dd-2a35-434b-b053-dba533e493a9 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058291 Aug 09 11:36:40.613627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 497/994] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:40 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:36:40.753459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9e91f605-56e5-4c6b-83c3-d8b7b5f3ce5b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:40.756227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9e91f605-56e5-4c6b-83c3-d8b7b5f3ce5b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:40.762462 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e91f605-56e5-4c6b-83c3-d8b7b5f3ce5b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:40.763358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e91f605-56e5-4c6b-83c3-d8b7b5f3ce5b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:40.763865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e91f605-56e5-4c6b-83c3-d8b7b5f3ce5b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:40.764681 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e91f605-56e5-4c6b-83c3-d8b7b5f3ce5b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:40.765327 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e91f605-56e5-4c6b-83c3-d8b7b5f3ce5b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:40.765981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e91f605-56e5-4c6b-83c3-d8b7b5f3ce5b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:40.772734 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=100 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:40.813682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9e91f605-56e5-4c6b-83c3-d8b7b5f3ce5b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064963 Aug 09 11:36:40.813682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 498/995] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 11:36:40 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 11:36:40.897740 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:40.898242 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:40.905624 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:40.906140 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:40.906580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:40.907316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:40.907771 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:40.908201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:40.934628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:36:41.019061 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-63c36591-0eaa-4bc5-8504-f22a4660ca6d tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 204 len: 0 microversion: 2.1 time: 0.124778 Aug 09 11:36:41.019660 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 498/996] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:36:40 2022] DELETE /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:36:41.028276 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:41.028939 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:41.035245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:41.035730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:41.036179 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:41.036855 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:41.037311 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:41.037809 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:41.166734 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:41.168958 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:41.178025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:41.178582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:41.179059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:41.179775 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:41.180236 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:41.180654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:41.186441 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:41.196898 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-abd128db-dfc8-4ede-9532-ef04a5c6d5a1 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1673 microversion: 2.1 time: 0.172296 Aug 09 11:36:41.197708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 499/997] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:41 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:36:41.341414 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:41.350268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:41.351980 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:41.353187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-831eef1c-28b4-4a1f-9251-c5be8752929a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1722 microversion: 2.20 time: 0.192882 Aug 09 11:36:41.353823 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 499/998] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:41 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:36:42.219388 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:42.219949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:42.230956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:42.231411 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:42.232141 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:42.232847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:42.233283 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:42.233860 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:42.372460 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:42.380911 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-97442ae2-7ffe-468f-9725-a8196ca7321b tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1673 microversion: 2.1 time: 0.165518 Aug 09 11:36:42.381881 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 500/999] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:42 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:36:42.382543 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:42.383787 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:42.395228 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:42.396248 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:42.397278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:42.398638 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:42.399576 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:42.400160 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:42.541174 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:42.549457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:42.550942 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:42.552207 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-959c3484-ce58-45eb-a457-c7f7b81192fd tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1722 microversion: 2.20 time: 0.179273 Aug 09 11:36:42.552768 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 500/1000] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:42 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:43.411943 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:43.412348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:43.423333 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:43.424107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:43.424907 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:43.425990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:43.426787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:43.427538 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:43.570094 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:43.574972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:43.575589 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:43.578747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6a57be9b-ba73-420d-b5fb-e18c4450905e tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1673 microversion: 2.1 time: 0.173893 Aug 09 11:36:43.579375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 501/1001] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:43 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:36:43.583246 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:43.583758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:43.584181 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:43.584868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:43.585313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:43.585731 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:43.728628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:43.736990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:43.738499 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:43.739689 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fbd23681-b243-4c6c-a33a-4191230e6ae7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1722 microversion: 2.20 time: 0.168626 Aug 09 11:36:43.740226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 501/1002] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:43 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:36:44.016083 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-15859878-8dd6-40ef-80c9-7b92a964a232 req-04f65b6e-c09c-4fcf-a1f8-d2374b4b1d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec43b88-6ed9-493d-8ac7-c9b9833dad9d", "name": "network-vif-unplugged", "status": "completed", "tag": "1e6ec79e-081d-462d-a29f-df7d6f78d422"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:44.025881 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-15859878-8dd6-40ef-80c9-7b92a964a232 req-04f65b6e-c09c-4fcf-a1f8-d2374b4b1d39 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:44.026366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-15859878-8dd6-40ef-80c9-7b92a964a232 req-04f65b6e-c09c-4fcf-a1f8-d2374b4b1d39 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:44.026763 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-15859878-8dd6-40ef-80c9-7b92a964a232 req-04f65b6e-c09c-4fcf-a1f8-d2374b4b1d39 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:44.038529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-15859878-8dd6-40ef-80c9-7b92a964a232 req-04f65b6e-c09c-4fcf-a1f8-d2374b4b1d39 service nova] Creating event network-vif-unplugged:1e6ec79e-081d-462d-a29f-df7d6f78d422 for instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d on hv-cinder-84989 Aug 09 11:36:44.043474 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-15859878-8dd6-40ef-80c9-7b92a964a232 req-04f65b6e-c09c-4fcf-a1f8-d2374b4b1d39 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031144 Aug 09 11:36:44.044064 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 502/1003] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:44.601370 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:44.601990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:44.610973 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:44.611476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:44.611920 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:44.612637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:44.613292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:44.613915 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:44.767684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:44.769053 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:44.779954 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:44.780896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:44.781811 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:44.783095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:44.784018 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:44.784853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:44.942354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:44.950372 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-00037ae9-f81f-4d1c-8ca9-e03975e63ef7 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1673 microversion: 2.1 time: 0.353625 Aug 09 11:36:44.950973 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 502/1004] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:44 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1673 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:36:45.085594 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:45.094125 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:45.095807 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:45.098290 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8dd83d9a-54da-4df8-b28e-11e658a4836b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1665 microversion: 2.20 time: 0.339370 Aug 09 11:36:45.099500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 503/1005] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:44 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1665 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:45.121287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0462a8f5-c5ef-4070-aeb3-784396540b17 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2078814a-5714-41c2-8056-53452eae2a2f"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:45.123865 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0462a8f5-c5ef-4070-aeb3-784396540b17 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:45.130315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0462a8f5-c5ef-4070-aeb3-784396540b17 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:45.130707 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0462a8f5-c5ef-4070-aeb3-784396540b17 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:45.131163 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0462a8f5-c5ef-4070-aeb3-784396540b17 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:45.131953 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0462a8f5-c5ef-4070-aeb3-784396540b17 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:45.132400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0462a8f5-c5ef-4070-aeb3-784396540b17 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:45.132818 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0462a8f5-c5ef-4070-aeb3-784396540b17 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:45.454226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0462a8f5-c5ef-4070-aeb3-784396540b17 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336723 Aug 09 11:36:45.454972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 503/1006] 10.222.0.59 () {62 vars in 1364 bytes} [Tue Aug 9 11:36:45 2022] POST /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments => generated 188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:36:45.562683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-51c93036-6466-46d4-8086-c78c059f583d req-92777e6c-c926-45df-823b-4ed3b749ed4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f087104-5044-4081-8005-b8ccb3e57299", "name": "network-vif-deleted", "tag": "176739a8-1344-413c-8634-a1ecb4b7622c"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:45.575821 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-51c93036-6466-46d4-8086-c78c059f583d req-92777e6c-c926-45df-823b-4ed3b749ed4f service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:45.576288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-51c93036-6466-46d4-8086-c78c059f583d req-92777e6c-c926-45df-823b-4ed3b749ed4f service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:45.576709 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-51c93036-6466-46d4-8086-c78c059f583d req-92777e6c-c926-45df-823b-4ed3b749ed4f service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:45.602545 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-51c93036-6466-46d4-8086-c78c059f583d req-92777e6c-c926-45df-823b-4ed3b749ed4f service nova] Creating event network-vif-deleted:176739a8-1344-413c-8634-a1ecb4b7622c for instance 2f087104-5044-4081-8005-b8ccb3e57299 on hv-cinder-84989 Aug 09 11:36:45.608173 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-51c93036-6466-46d4-8086-c78c059f583d req-92777e6c-c926-45df-823b-4ed3b749ed4f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048807 Aug 09 11:36:45.609729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 504/1007] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:36:45.618769 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:36:45.619408 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:45.629684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:45.630840 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:45.631772 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:45.633099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:45.634834 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:45.635524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:45.697115 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117793) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 11:36:45.799313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8b35c5e0-d858-43ae-a807-f06f60b016fb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/action" status: 202 len: 0 microversion: 2.20 time: 0.178691 Aug 09 11:36:45.799313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 504/1008] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 9 11:36:45 2022] POST /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:36:45.808529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:45.809351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:45.817942 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:45.818592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:45.819128 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:45.819909 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:45.820481 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:45.820924 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:45.973944 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:45.974570 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:45.983792 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:45.987544 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:45.998216 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:45.998921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:45.999721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:46.000318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:46.000893 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:46.004684 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:46.006534 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:46.014842 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-aad719ec-9c11-4cc6-852f-f613c4adbe03 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1751 microversion: 2.20 time: 0.211179 Aug 09 11:36:46.015429 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 505/1009] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:45 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1751 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:46.081917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:46.082514 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:46.083551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:46.084674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lazy-loading 'fault' on Instance uuid 2f087104-5044-4081-8005-b8ccb3e57299 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:36:46.149790 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f80c1f4f2d04a9b80ab0c315dfe180d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '001b779aebf8445eba01022c8c9abe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:46.159799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aaab3a65-2439-43af-aa06-2be6be55600a tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 200 len: 1328 microversion: 2.1 time: 0.190695 Aug 09 11:36:46.160577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 505/1010] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:45 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:36:47.040407 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:47.041004 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:47.047982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:47.048470 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:47.048896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:47.049589 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:47.050040 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:47.050463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:47.183312 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:47.184735 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:47.190042 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:47.191700 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:47.192243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:47.193374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:47.193565 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:47.194262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:47.194944 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:47.199262 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:47.200781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:47.201960 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-680c5c9c-864f-4c44-be13-64bc21870f26 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1751 microversion: 2.20 time: 0.165651 Aug 09 11:36:47.202512 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 506/1011] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:47 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:47.213569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] HTTP exception thrown: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Request method failure captured: Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 HTTP/1.1 Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kSmKvDFTiK0haaRbWM_acg7l17AV8YDEwtcet0RoXCUlfqnVDAtEhsVsKLC1OezaVAc7YEdpK4MJPrMv8h_Gfui7uKiLyZxOB61Rl3ATj-vew0huthltsAWG6k6uZMkV5n8teUAGeZNQszFwRzX-aI-4oZnDRFLQzh6P-1c9hh8PPw Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:36:47.215268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_001b779aebf8445eba01022c8c9abe19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 0f80c1f4f2d04a9b80ab0c315dfe180d Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:47.216989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '2f087104-5044-4081-8005-b8ccb3e57299'} Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:47.217844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:47.219389 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:47.221001 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Returning 404 to user: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:47.221001 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2f6c007e-660c-48c1-b7eb-1e4248aaff4c tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 404 len: 111 microversion: 2.1 time: 0.037249 Aug 09 11:36:47.221001 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 506/1012] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:47 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:47.225723 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5c60954a-d9b4-4b02-acce-caacc10fe971 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '.version_select at 0x7fece2608940>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:47.247065 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5c60954a-d9b4-4b02-acce-caacc10fe971 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128157752" status: 202 len: 0 microversion: 2.1 time: 0.025100 Aug 09 11:36:47.247659 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 507/1013] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 9 11:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128157752 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:36:48.228822 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:48.229527 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:48.237914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:48.238482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:48.238945 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:48.240012 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:48.240439 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:48.240896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:48.375884 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:48.384734 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:48.386236 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:48.387498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fcb2d888-9fb4-48e8-b8c6-cb10f7543442 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1751 microversion: 2.20 time: 0.164847 Aug 09 11:36:48.388056 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 507/1014] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:48 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:49.411351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:49.411962 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:49.418399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:49.418923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:49.419352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:49.420073 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:49.420555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:49.420976 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:49.579383 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:49.588392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:49.589901 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:49.591114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4213e04c-fc6e-4dbc-9391-903c4d0d0c21 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1753 microversion: 2.20 time: 0.184448 Aug 09 11:36:49.591710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 508/1015] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:49 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:50.616761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:50.617321 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:50.624019 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:50.624487 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:50.624896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:50.625583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:50.626025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:50.626438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:50.753426 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:50.762433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:50.764006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:50.765136 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-959083b2-2c85-475c-9d49-8ba305d3c32f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1753 microversion: 2.20 time: 0.154145 Aug 09 11:36:50.765821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 508/1016] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:50 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:51.788448 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:51.789231 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:51.796580 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:51.797109 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:51.797807 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:51.798237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:51.798701 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:51.799505 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:52.014851 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:52.023797 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:52.025321 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:52.026486 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0161483b-3cf2-446e-894d-324d4b1a3011 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.242063 Aug 09 11:36:52.027233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 509/1017] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:51 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:52.606454 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:52.607321 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:52.615019 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:52.615551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:52.616057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:52.617166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:52.617789 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:52.618222 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:52.622457 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:52.632952 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] HTTP exception thrown: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Request method failure captured: Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 HTTP/1.1 Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kSmKvDFTiK0haaRbWM_acg7l17AV8YDEwtcet0RoXCUlfqnVDAtEhsVsKLC1OezaVAc7YEdpK4MJPrMv8h_Gfui7uKiLyZxOB61Rl3ATj-vew0huthltsAWG6k6uZMkV5n8teUAGeZNQszFwRzX-aI-4oZnDRFLQzh6P-1c9hh8PPw Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:36:52.634505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_001b779aebf8445eba01022c8c9abe19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 0f80c1f4f2d04a9b80ab0c315dfe180d Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.636176 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '2f087104-5044-4081-8005-b8ccb3e57299'} Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:52.637094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.638776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.640299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Returning 404 to user: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:52.640299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ced177ef-d238-47b7-adea-e7a96aba5876 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 404 len: 111 microversion: 2.1 time: 0.033435 Aug 09 11:36:52.640299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 509/1018] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:36:52 2022] DELETE /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:52.644694 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:52.645296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 2f087104-5044-4081-8005-b8ccb3e57299] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:52.651698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:52.652209 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:52.652635 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:52.653320 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:52.653764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:52.654227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:52.667940 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] HTTP exception thrown: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Request method failure captured: Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 HTTP/1.1 Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kSmKvDFTiK0haaRbWM_acg7l17AV8YDEwtcet0RoXCUlfqnVDAtEhsVsKLC1OezaVAc7YEdpK4MJPrMv8h_Gfui7uKiLyZxOB61Rl3ATj-vew0huthltsAWG6k6uZMkV5n8teUAGeZNQszFwRzX-aI-4oZnDRFLQzh6P-1c9hh8PPw Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:36:52.669600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_001b779aebf8445eba01022c8c9abe19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 0f80c1f4f2d04a9b80ab0c315dfe180d Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.672349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '2f087104-5044-4081-8005-b8ccb3e57299'} Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:52.673586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. Aug 09 11:36:52.675117 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:52.676571 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Returning 404 to user: Instance 2f087104-5044-4081-8005-b8ccb3e57299 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:52.676571 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c2d68d7d-9441-463f-8b31-59bc730385d0 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299" status: 404 len: 111 microversion: 2.1 time: 0.030275 Aug 09 11:36:52.676571 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 510/1019] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:52 2022] GET /compute/v2.1/servers/2f087104-5044-4081-8005-b8ccb3e57299 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:53.049334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:53.050242 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:53.057622 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:53.057992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:53.058423 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:53.059157 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:53.059786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:53.060211 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:53.249797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:53.262427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:53.264148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:53.265644 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-641f3383-b581-4db9-9a93-81a25490395e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.220344 Aug 09 11:36:53.271399 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 510/1020] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:53 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:53.815908 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:53.817074 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:53.824120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:53.824875 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:53.825473 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:53.826359 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:53.827076 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:53.827656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:53.843614 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] HTTP exception thrown: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Request method failure captured: Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 HTTP/1.1 Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kSmKvDFTiK0haaRbWM_acg7l17AV8YDEwtcet0RoXCUlfqnVDAtEhsVsKLC1OezaVAc7YEdpK4MJPrMv8h_Gfui7uKiLyZxOB61Rl3ATj-vew0huthltsAWG6k6uZMkV5n8teUAGeZNQszFwRzX-aI-4oZnDRFLQzh6P-1c9hh8PPw Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:36:53.845210 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_001b779aebf8445eba01022c8c9abe19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 0f80c1f4f2d04a9b80ab0c315dfe180d Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.846854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '26bbe60e-21bf-4703-8873-5190575e1ec9'} Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:53.847775 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.849245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.850765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Returning 404 to user: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:53.850765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-d626d435-d4b0-4208-a13c-00ca803836b5 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 404 len: 111 microversion: 2.1 time: 0.034866 Aug 09 11:36:53.850765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 511/1021] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:36:53 2022] DELETE /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:36:53.858747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:53.859453 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] [instance: 26bbe60e-21bf-4703-8873-5190575e1ec9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:53.868636 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:53.869139 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:53.869552 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:53.870315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:53.871353 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:53.871898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:53.888221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] HTTP exception thrown: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Request method failure captured: Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 HTTP/1.1 Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kSmKvDFTiK0haaRbWM_acg7l17AV8YDEwtcet0RoXCUlfqnVDAtEhsVsKLC1OezaVAc7YEdpK4MJPrMv8h_Gfui7uKiLyZxOB61Rl3ATj-vew0huthltsAWG6k6uZMkV5n8teUAGeZNQszFwRzX-aI-4oZnDRFLQzh6P-1c9hh8PPw Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:36:53.889904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/001b779aebf8445eba01022c8c9abe19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_001b779aebf8445eba01022c8c9abe19", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 001b779aebf8445eba01022c8c9abe19 Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1820531462 Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 0f80c1f4f2d04a9b80ab0c315dfe180d Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeTestJSON-1820531462-project Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.891582 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '26bbe60e-21bf-4703-8873-5190575e1ec9'} Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:36:53.896169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. Aug 09 11:36:53.898344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:36:53.899821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] Returning 404 to user: Instance 26bbe60e-21bf-4703-8873-5190575e1ec9 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:36:53.899821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-75ba586b-a132-4cb5-bc16-8f8857c5f314 tempest-AttachVolumeTestJSON-1820531462 tempest-AttachVolumeTestJSON-1820531462-project] 10.222.0.59 "GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9" status: 404 len: 111 microversion: 2.1 time: 0.037706 Aug 09 11:36:53.899821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 511/1022] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:36:53 2022] GET /compute/v2.1/servers/26bbe60e-21bf-4703-8873-5190575e1ec9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 11:36:54.291377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:54.292490 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:54.306503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:54.307499 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:54.308206 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:54.309340 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:54.310122 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:54.310790 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:54.460107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:54.469922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:54.473003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:54.474785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-759c9318-ccf7-4cfb-9d06-4ada75fbc096 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.188836 Aug 09 11:36:54.475990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 512/1023] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:54 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:36:55.498183 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:55.499628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:55.507664 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:55.508503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:55.509315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:55.510343 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:55.510844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:55.511603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:55.675153 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:55.686310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:55.688446 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:55.689923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-57889282-f262-44ae-a64b-962a4c300eb2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.196271 Aug 09 11:36:55.690481 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 512/1024] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:55 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:56.715561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:56.717257 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:56.734215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:56.735106 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:56.735747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:56.736710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:56.737477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:56.737897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:56.957896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:56.975501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:56.978548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:56.980282 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-df38447c-5ae9-4901-be6c-6a1aa47a501d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.270523 Aug 09 11:36:56.981811 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 513/1025] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:56 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:36:58.005723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:58.007088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:58.017151 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:58.017878 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:58.018476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:58.019612 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:58.020597 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:58.021752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:58.242424 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:58.261382 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:58.262914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:58.264295 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-45103e36-4103-49cf-a92d-a155e690c260 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.263826 Aug 09 11:36:58.268088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 513/1026] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:57 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:36:59.287377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:36:59.288828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:36:59.313942 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:59.314396 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:59.314848 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:59.316619 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:36:59.317550 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:36:59.318326 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:36:59.553042 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:59.562335 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:59.563856 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:36:59.565132 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c6738a29-8e37-4be1-b765-7d0bbdbdf436 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.282039 Aug 09 11:36:59.565635 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 514/1027] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:36:59 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:37:00.591726 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:00.593273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:00.604633 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:00.605414 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:00.606010 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:00.606918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:00.607526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:00.608282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:00.763762 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:00.775723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:00.777998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:00.780057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-af595cae-401e-45b3-b9f4-d8a551635d4d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.193045 Aug 09 11:37:00.781239 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 514/1028] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:00 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:01.807120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:01.807764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:01.816477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:01.817057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:01.817625 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:01.818562 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:01.819143 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:01.819569 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:01.966081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:01.978115 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:01.979666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:01.980865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bc433778-574d-411b-93f0-6d1775a39706 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.180023 Aug 09 11:37:01.981993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 515/1029] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:01 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:03.005661 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:03.006379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:03.013427 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:03.013913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:03.014358 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:03.015083 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:03.015558 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:03.016002 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:03.158571 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:03.167645 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:03.169149 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:03.170307 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f58e82c5-bf99-4587-a6d0-df58c5e6c58b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.168615 Aug 09 11:37:03.170865 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 515/1030] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:03 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:03.404375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8d6f68d6-c300-41a7-aff6-27b9cb48f292 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:37:03.407942 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8d6f68d6-c300-41a7-aff6-27b9cb48f292 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:03.414329 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d6f68d6-c300-41a7-aff6-27b9cb48f292 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:03.414932 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d6f68d6-c300-41a7-aff6-27b9cb48f292 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:03.415652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d6f68d6-c300-41a7-aff6-27b9cb48f292 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:03.416315 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d6f68d6-c300-41a7-aff6-27b9cb48f292 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:03.416832 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d6f68d6-c300-41a7-aff6-27b9cb48f292 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:03.417302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8d6f68d6-c300-41a7-aff6-27b9cb48f292 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:04.195670 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:04.196330 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:04.205116 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:04.206094 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:04.206761 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:04.207844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:04.208469 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:04.209100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:04.344871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:04.353675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:04.355415 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:04.357717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f78e4202-eab3-4f67-bccc-7bd8fa24635e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.166538 Aug 09 11:37:04.357717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 516/1031] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:04 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:05.381820 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:05.382499 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:05.389366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:05.389859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:05.390288 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:05.391006 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:05.391452 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:05.391873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:05.527071 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:05.536610 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:05.538507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:05.539885 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8f74933b-03df-479a-8393-93f08f2d20bf tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.162998 Aug 09 11:37:05.540538 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 517/1032] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:05 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:06.563633 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:06.564287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:06.571345 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:06.571783 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:06.572215 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:06.572912 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:06.573365 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:06.573772 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:06.712501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:06.721783 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:06.723400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:06.724855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6f701cc3-394e-4f81-92b8-030b4d90b713 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.165226 Aug 09 11:37:06.725500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 518/1033] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:06 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:07.664694 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8d6f68d6-c300-41a7-aff6-27b9cb48f292 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "POST /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2/action" status: 200 len: 62592 microversion: 2.1 time: 4.264267 Aug 09 11:37:07.665247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 516/1034] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 11:37:03 2022] POST /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2/action => generated 62592 bytes in 4266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:37:07.748899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:07.749521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:07.757600 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:07.758314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:07.758885 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:07.759751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:07.760410 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:07.760841 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:07.908538 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:07.918036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:07.919518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:07.920768 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-99e916ea-cf3d-4fe6-8869-9adb47fbcd2f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.175766 Aug 09 11:37:07.921331 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 519/1035] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:07 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:08.839518 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:08.841427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:08.849876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:08.850529 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:08.851645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:08.852445 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:08.853043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:08.853462 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:08.887511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:37:08.929961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:09.009686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-652335cf-0442-43ab-928f-2f0f8bcb1eb8 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 204 len: 0 microversion: 2.1 time: 0.181062 Aug 09 11:37:09.010859 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 517/1036] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:37:08 2022] DELETE /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:37:09.019855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-f4828e46-29b1-4e10-9cbd-eac0ccfd445c req-84378f99-3912-45c8-84bb-69d3c2634563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dafb83be-fb97-4c38-9818-862de58903e2", "tag": "c7e24f87-826e-40ca-ae47-c2109c4d697b"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:37:09.025010 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:09.029736 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:09.030309 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:09.036481 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:09.036974 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:09.037415 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:09.038127 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:09.038576 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:09.038723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f4828e46-29b1-4e10-9cbd-eac0ccfd445c req-84378f99-3912-45c8-84bb-69d3c2634563 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:09.039034 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:09.039327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f4828e46-29b1-4e10-9cbd-eac0ccfd445c req-84378f99-3912-45c8-84bb-69d3c2634563 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:09.039768 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-f4828e46-29b1-4e10-9cbd-eac0ccfd445c req-84378f99-3912-45c8-84bb-69d3c2634563 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:09.060213 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-f4828e46-29b1-4e10-9cbd-eac0ccfd445c req-84378f99-3912-45c8-84bb-69d3c2634563 service nova] Creating event network-changed:c7e24f87-826e-40ca-ae47-c2109c4d697b for instance dafb83be-fb97-4c38-9818-862de58903e2 on hv-cinder-84989 Aug 09 11:37:09.068812 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-f4828e46-29b1-4e10-9cbd-eac0ccfd445c req-84378f99-3912-45c8-84bb-69d3c2634563 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235475 Aug 09 11:37:09.069764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 520/1037] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:37:09.077818 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:09.078519 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:09.087048 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:09.087603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:09.088058 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:09.088781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:09.089514 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:09.089951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:09.235714 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:09.252379 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:09.254340 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:09.255817 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4086ddbb-7602-4408-b53f-0ccf9ca29f3e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.243702 Aug 09 11:37:09.256593 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 518/1038] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:09 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:09.297811 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:09.305658 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-52777180-042e-4ca5-926d-9ef08002ed0d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.233603 Aug 09 11:37:09.306234 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 521/1039] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:09 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:10.280722 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:10.281347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:10.283891 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:10.289602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:10.290023 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:10.290487 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:10.291213 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:10.291664 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:10.292086 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:10.329597 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:10.331088 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:10.339807 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:10.340298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:10.340734 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:10.341448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:10.341911 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:10.342337 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:10.480941 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:10.489841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:10.491398 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:10.492590 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bacd4395-2f9d-40b7-897b-f94b6e38f1f9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.215938 Aug 09 11:37:10.493163 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 519/1040] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:10 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:10.517142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:10.524777 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b3884cec-0134-435b-ae1b-0fdf54b2d27d tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.201276 Aug 09 11:37:10.525355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 522/1041] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:10 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:11.522479 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:11.523324 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:11.531822 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:11.532387 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:11.532810 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:11.533798 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:11.534507 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:11.535197 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:11.545668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:11.546238 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:11.552989 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:11.553476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:11.553891 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:11.554597 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:11.555188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:11.555586 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:11.742983 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:11.751812 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:11.751965 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:11.753253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:11.754416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-05036f81-de47-4c0d-a1ae-7ad686e28a72 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.236322 Aug 09 11:37:11.755185 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 520/1042] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:11 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:11.759725 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e787d37d-b405-4c27-aee6-eaa19e535f86 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.217894 Aug 09 11:37:11.760388 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 523/1043] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:11 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:12.778673 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:12.779278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:12.781954 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:12.782569 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:12.786064 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:12.786551 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:12.787032 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:12.787735 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:12.788189 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:12.788721 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:12.789185 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:12.789710 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:12.790187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:12.790895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:12.791346 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:12.791772 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:13.007741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:13.012074 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:13.017884 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:13.019437 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:13.019862 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bd74d3ad-1516-4ad3-a90c-4ae3a13240cc tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.241779 Aug 09 11:37:13.020433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 524/1044] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:12 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:13.020641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ecadc823-b39d-48f5-884f-98c0f546f0d7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.246625 Aug 09 11:37:13.021230 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 521/1045] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:12 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:14.042061 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:14.042600 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:14.043504 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:14.044105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:14.049229 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:14.049720 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:14.050157 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:14.050689 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:14.050856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:14.051211 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:14.051354 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:14.051641 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:14.051808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:14.052346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:14.052781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:14.053201 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:14.249304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:14.254441 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:14.261593 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:14.263138 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:14.264304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1331e007-e6e2-4935-b6ae-a4487db5c221 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.224677 Aug 09 11:37:14.264477 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6a07b747-6f25-433b-bfcb-338286976dfa tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.226741 Aug 09 11:37:14.265073 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 522/1046] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:14 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:14.265199 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 525/1047] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:14 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:15.285808 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:15.286424 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:15.287305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:15.287898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:15.293610 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:15.294095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:15.294511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:15.294769 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:15.295245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:15.295379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:15.295690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:15.295868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:15.296127 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:15.296477 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:15.296930 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:15.297402 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:15.505097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:15.508685 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:15.514005 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:15.515551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:15.516706 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cd754294-a188-44d3-ad01-56feb6f5ae4c tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.234817 Aug 09 11:37:15.516828 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-490847af-70e4-45f1-8de6-79258a408745 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.233632 Aug 09 11:37:15.517266 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 526/1049] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:15 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:37:15.517409 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 523/1049] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:15 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:16.538306 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:16.538987 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:16.539300 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:16.539903 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:16.546011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:16.546496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:16.546652 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:16.546960 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:16.547156 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:16.547574 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:16.547797 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:16.548120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:16.548245 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:16.548542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:16.548729 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:16.549126 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:16.754098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:16.757253 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:16.760975 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:16.762354 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-464befef-d897-4ef9-afe7-11c8868dcbe3 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.227991 Aug 09 11:37:16.763133 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 524/1050] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:16 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:16.767343 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:16.768863 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:16.770049 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6ee0bfc9-728f-47cd-a159-a0b0805fc685 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.234559 Aug 09 11:37:16.770597 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 527/1051] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:16 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:17.784298 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:17.784856 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:17.791680 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:17.792154 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:17.792286 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:17.792733 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:17.792821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:17.793247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:17.793799 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:17.794098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:17.799278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:17.799728 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:17.800155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:17.800868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:17.801316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:17.801738 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:18.009378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:18.016126 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:18.018067 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f2f9a609-ec97-4199-90ce-3b5195758321 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1568 microversion: 2.1 time: 0.237697 Aug 09 11:37:18.018669 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 525/1052] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:17 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:18.027732 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:18.029515 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:18.030704 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a043e359-c15c-4cfb-acaf-8bd4c128b9de tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.242415 Aug 09 11:37:18.031583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 528/1053] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:17 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:37:19.040551 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:19.041302 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:19.047865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:19.048369 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:19.049196 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:19.050264 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:19.050883 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:19.051516 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:19.055882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:19.057959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:19.067127 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:19.068334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:19.068952 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:19.070290 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:19.070988 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:19.071574 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:19.279169 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:19.286018 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:19.289392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a7f33dec-11fc-46fe-96b8-a09b3a26f740 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1450 microversion: 2.1 time: 0.252711 Aug 09 11:37:19.295567 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:19.297081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:19.298461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8543b817-59aa-479f-8f6d-8831234ca05a tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.247633 Aug 09 11:37:19.299109 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 529/1054] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:19 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:37:19.304938 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 526/1055] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:19 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1450 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:20.055398 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-bd8ac046-9923-4f85-87d0-8f40ae3a3242 req-374f4cc5-e626-4d9a-85ab-2e8553458cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafb83be-fb97-4c38-9818-862de58903e2", "name": "network-vif-deleted", "tag": "c7e24f87-826e-40ca-ae47-c2109c4d697b"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:37:20.079070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-bd8ac046-9923-4f85-87d0-8f40ae3a3242 req-374f4cc5-e626-4d9a-85ab-2e8553458cda service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:20.079717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-bd8ac046-9923-4f85-87d0-8f40ae3a3242 req-374f4cc5-e626-4d9a-85ab-2e8553458cda service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:20.080041 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-bd8ac046-9923-4f85-87d0-8f40ae3a3242 req-374f4cc5-e626-4d9a-85ab-2e8553458cda service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:20.095889 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-bd8ac046-9923-4f85-87d0-8f40ae3a3242 req-374f4cc5-e626-4d9a-85ab-2e8553458cda service nova] Creating event network-vif-deleted:c7e24f87-826e-40ca-ae47-c2109c4d697b for instance dafb83be-fb97-4c38-9818-862de58903e2 on hv-cinder-84989 Aug 09 11:37:20.104392 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-bd8ac046-9923-4f85-87d0-8f40ae3a3242 req-374f4cc5-e626-4d9a-85ab-2e8553458cda service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051994 Aug 09 11:37:20.105603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 530/1056] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:37:20.312240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:20.312865 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:20.319468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:20.320186 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:20.320620 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:20.321739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:20.322017 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:20.322757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:20.322948 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:20.323527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:20.330749 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:20.331325 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:20.331831 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:20.332570 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:20.333029 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:20.333455 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:20.393064 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b477645d5d814644aa77e11066f0489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5b4feb5fe1746a2b54b81e61558d4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:20.403495 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-dca4258e-cdad-4cf3-bd0f-a8eda985d1d1 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 200 len: 1219 microversion: 2.1 time: 0.093946 Aug 09 11:37:20.403645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 527/1057] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:20 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:37:20.510964 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:20.521288 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:20.522795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:20.524055 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-065a322c-ae41-4e27-9de0-b5a029be6535 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.206280 Aug 09 11:37:20.524676 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 531/1058] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:20 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:21.426544 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:21.427399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] [instance: dafb83be-fb97-4c38-9818-862de58903e2] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:21.434780 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:21.435644 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:21.436263 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:21.437433 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:21.438119 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:21.438796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:21.456616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] HTTP exception thrown: Instance dafb83be-fb97-4c38-9818-862de58903e2 could not be found. Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Request method failure captured: Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 HTTP/1.1 Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kTSQhUcI_7isG9HjCpOBtAeRfmiVaEJCeTXqqccO0w67QvpBfUzqa5PMmQH_OFh72MNkfRIACotOjO91JfeSiH54zTcmT9_U5f6zhvFcgxFaALIZrwDAmdkUiO80SXe2fJEe8JHBhpOR6vqwMmdRQohZMkQLDh8i4FEC8HpQomrLt0 Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: d5b4feb5fe1746a2b54b81e61558d4c0 Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestShelveInstance-1137142319 Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:37:21.458435 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5b4feb5fe1746a2b54b81e61558d4c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5b4feb5fe1746a2b54b81e61558d4c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d5b4feb5fe1746a2b54b81e61558d4c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d5b4feb5fe1746a2b54b81e61558d4c0", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestShelveInstance-1137142319 Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: d5b4feb5fe1746a2b54b81e61558d4c0 Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestShelveInstance-1137142319 Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-TestShelveInstance-1137142319-project Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: b477645d5d814644aa77e11066f0489d Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestShelveInstance-1137142319-project Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance dafb83be-fb97-4c38-9818-862de58903e2 could not be found. Aug 09 11:37:21.460346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'dafb83be-fb97-4c38-9818-862de58903e2'} Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafb83be-fb97-4c38-9818-862de58903e2 could not be found. Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:37:21.461301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafb83be-fb97-4c38-9818-862de58903e2 could not be found. Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafb83be-fb97-4c38-9818-862de58903e2 could not be found. Aug 09 11:37:21.462646 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:37:21.463924 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Returning 404 to user: Instance dafb83be-fb97-4c38-9818-862de58903e2 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:37:21.463924 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-55a9f021-94a2-4401-a373-de0438081cf6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2" status: 404 len: 111 microversion: 2.1 time: 0.038357 Aug 09 11:37:21.463924 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 528/1059] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:37:21 2022] GET /compute/v2.1/servers/dafb83be-fb97-4c38-9818-862de58903e2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:37:21.549667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:21.550870 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:21.559707 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:21.561022 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:21.562196 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:21.562941 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:21.563587 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:21.564011 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:21.666764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1d3d729b-71b4-4ceb-8cab-70819b3d1fc6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] Calling method '.version_select at 0x7fece2476d30>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:21.699773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1d3d729b-71b4-4ceb-8cab-70819b3d1fc6 tempest-TestShelveInstance-1137142319 tempest-TestShelveInstance-1137142319-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-765636033" status: 202 len: 0 microversion: 2.1 time: 0.036723 Aug 09 11:37:21.700351 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 529/1060] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 11:37:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-765636033 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:37:21.741476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:21.756027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:21.757708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:21.758987 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-012d0c77-22dd-4667-9ad2-b59544ce8881 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.215927 Aug 09 11:37:21.759574 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 532/1061] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:21 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:22.783251 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:22.783885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:22.793375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:22.793881 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:22.794556 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:22.795525 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:22.796157 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:22.796836 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:22.948515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:22.958158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:22.959754 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:22.961027 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3b2ade82-db55-4832-afd5-011b097a18c7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.182817 Aug 09 11:37:22.963214 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 530/1062] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:22 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:23.991281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:23.992579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:24.001361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:24.002666 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:24.003587 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:24.004719 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:24.005735 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:24.006320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:24.207408 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:24.221412 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:24.224501 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:24.227856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fe6582fc-afec-4117-a187-395db05d15ee tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.242959 Aug 09 11:37:24.232959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 533/1063] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:23 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:25.265820 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:25.266802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:25.274790 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:25.275978 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:25.276468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:25.277525 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:25.278170 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:25.278852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:25.465148 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:25.477993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:25.479584 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:25.480876 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f8fa8fe9-bba1-4893-9f3a-44fc12a8b711 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.224465 Aug 09 11:37:25.481416 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 531/1064] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:25 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:26.504437 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:26.505325 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:26.517568 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:26.518063 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:26.518518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:26.519372 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:26.519827 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:26.520251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:26.707526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:26.716267 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:26.717790 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:26.719007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cd6d7048-43ec-4057-bd6d-5c59efc2d97f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.218510 Aug 09 11:37:26.719579 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 534/1065] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:26 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:27.743744 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:27.744984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:27.752205 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:27.752704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:27.753141 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:27.753982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:27.754403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:27.754921 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:27.902358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:27.911129 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:27.912630 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:27.913791 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-83511f2b-bfbc-403e-9828-35ac3b155aae tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.174023 Aug 09 11:37:27.914345 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 532/1066] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:27 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:28.943002 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:28.945751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:28.956547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:28.957040 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:28.957524 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:28.958239 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:28.958698 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:28.959150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:29.116935 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:29.127484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:29.128984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:29.130228 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-74463648-8c32-45bb-a391-9c7d9c096ea2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.192986 Aug 09 11:37:29.130795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 535/1067] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:28 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:30.153792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:30.154577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:30.166369 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:30.167170 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:30.167855 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:30.168807 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:30.169477 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:30.170062 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:30.245077 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-395dff8e-00dd-4229-bdd0-87af8635924a req-bf5f6626-a5a0-4eda-8dbc-39d96dfa0332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec43b88-6ed9-493d-8ac7-c9b9833dad9d", "name": "network-vif-plugged", "status": "completed", "tag": "1e6ec79e-081d-462d-a29f-df7d6f78d422"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:37:30.264428 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-395dff8e-00dd-4229-bdd0-87af8635924a req-bf5f6626-a5a0-4eda-8dbc-39d96dfa0332 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:30.265379 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-395dff8e-00dd-4229-bdd0-87af8635924a req-bf5f6626-a5a0-4eda-8dbc-39d96dfa0332 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:30.265996 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-395dff8e-00dd-4229-bdd0-87af8635924a req-bf5f6626-a5a0-4eda-8dbc-39d96dfa0332 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:30.282867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-395dff8e-00dd-4229-bdd0-87af8635924a req-bf5f6626-a5a0-4eda-8dbc-39d96dfa0332 service nova] Creating event network-vif-plugged:1e6ec79e-081d-462d-a29f-df7d6f78d422 for instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d on hv-cinder-84989 Aug 09 11:37:30.291256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-395dff8e-00dd-4229-bdd0-87af8635924a req-bf5f6626-a5a0-4eda-8dbc-39d96dfa0332 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050146 Aug 09 11:37:30.293325 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 536/1068] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:37:30.336186 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:30.345979 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:30.347652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:30.349127 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5e725a11-a3a7-449f-9219-746fbaa1ecf5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.199450 Aug 09 11:37:30.349757 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 533/1069] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:30 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:31.372740 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:31.373483 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:31.380454 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:31.380932 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:31.381437 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:31.382050 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:31.382525 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:31.383059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:31.531921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:31.541108 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:31.542619 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:31.543881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-421f9c03-ceb7-4d87-b372-b492bbc671d5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.175424 Aug 09 11:37:31.544476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 537/1070] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:31 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:32.567151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:32.568098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:32.575346 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:32.575874 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:32.576301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:32.577198 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:32.577816 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:32.578405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:32.767503 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:32.784861 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:32.787215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:32.788802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-908fe45c-baf7-4e22-b9a3-4acb260b1cbe tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1809 microversion: 2.20 time: 0.225767 Aug 09 11:37:32.789803 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 534/1071] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:32 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:37:33.814493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:37:33.816262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:37:33.823431 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:33.824111 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:33.824704 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:33.825725 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:37:33.826205 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:37:33.826791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:37:33.974601 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:33.992947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:33.994560 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:37:33.995919 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ed4af48d-993b-4eaf-b5fc-011f5cbba80d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1796 microversion: 2.20 time: 0.186539 Aug 09 11:37:33.996471 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 538/1072] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:37:33 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1796 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:38:43.959705 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:38:43.960613 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:38:53.443590 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:53.444678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:53.451722 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-bd7a20c4-7a2d-4fe6-b30c-8e6cff377e40 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:53.452421 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-bd7a20c4-7a2d-4fe6-b30c-8e6cff377e40 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:38:53.464926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd7a20c4-7a2d-4fe6-b30c-8e6cff377e40 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:53.465650 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd7a20c4-7a2d-4fe6-b30c-8e6cff377e40 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:53.466053 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd7a20c4-7a2d-4fe6-b30c-8e6cff377e40 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:53.466762 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd7a20c4-7a2d-4fe6-b30c-8e6cff377e40 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:53.467245 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd7a20c4-7a2d-4fe6-b30c-8e6cff377e40 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:53.467668 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-bd7a20c4-7a2d-4fe6-b30c-8e6cff377e40 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:53.502463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-bd7a20c4-7a2d-4fe6-b30c-8e6cff377e40 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments/2078814a-5714-41c2-8056-53452eae2a2f" status: 200 len: 194 microversion: 2.20 time: 0.061791 Aug 09 11:38:53.503100 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 535/1073] 10.222.0.59 () {60 vars in 1454 bytes} [Tue Aug 9 11:38:53 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments/2078814a-5714-41c2-8056-53452eae2a2f => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:38:53.570321 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=37 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:53.571196 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=58 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:53.575836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:53.576334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:38:53.583455 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:53.583931 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:53.584369 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:53.585070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:53.585522 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:53.585949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:53.669208 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lazy-loading 'services' on Instance uuid dec43b88-6ed9-493d-8ac7-c9b9833dad9d {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:38:53.754330 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-19bf465c-8f59-4915-bf2e-e5145fc88ad7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments/2078814a-5714-41c2-8056-53452eae2a2f" status: 202 len: 0 microversion: 2.20 time: 0.185609 Aug 09 11:38:53.754986 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 539/1074] 10.222.0.59 () {60 vars in 1457 bytes} [Tue Aug 9 11:38:53 2022] DELETE /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments/2078814a-5714-41c2-8056-53452eae2a2f => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:38:53.763745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e24420ba-317b-461d-a1b5-1b233d8cd70d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:53.765929 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e24420ba-317b-461d-a1b5-1b233d8cd70d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:38:53.772147 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e24420ba-317b-461d-a1b5-1b233d8cd70d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:53.772642 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e24420ba-317b-461d-a1b5-1b233d8cd70d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:53.773158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e24420ba-317b-461d-a1b5-1b233d8cd70d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:53.774375 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e24420ba-317b-461d-a1b5-1b233d8cd70d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:53.774854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e24420ba-317b-461d-a1b5-1b233d8cd70d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:53.775290 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e24420ba-317b-461d-a1b5-1b233d8cd70d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:53.805631 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e24420ba-317b-461d-a1b5-1b233d8cd70d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045952 Aug 09 11:38:53.806406 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 536/1075] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 11:38:53 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 11:38:54.821494 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ea17e8cc-e4d7-43d0-9956-78cc933f3217 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:54.823937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ea17e8cc-e4d7-43d0-9956-78cc933f3217 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:38:54.830922 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea17e8cc-e4d7-43d0-9956-78cc933f3217 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:54.831400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea17e8cc-e4d7-43d0-9956-78cc933f3217 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:54.831835 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea17e8cc-e4d7-43d0-9956-78cc933f3217 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:54.832527 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea17e8cc-e4d7-43d0-9956-78cc933f3217 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:54.832979 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea17e8cc-e4d7-43d0-9956-78cc933f3217 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:54.833402 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea17e8cc-e4d7-43d0-9956-78cc933f3217 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:54.864824 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ea17e8cc-e4d7-43d0-9956-78cc933f3217 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048193 Aug 09 11:38:54.865667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 540/1076] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 11:38:54 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:38:54.937011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:54.937554 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:38:54.944464 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:54.945003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:54.945433 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:54.946127 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:54.946580 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:54.947112 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:54.973054 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Going to try to terminate instance {{(pid=117792) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:38:55.054357 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-750a652d-f467-486b-a712-73c8d2046c8e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 204 len: 0 microversion: 2.20 time: 0.122160 Aug 09 11:38:55.055368 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 537/1077] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 9 11:38:54 2022] DELETE /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 11:38:55.064717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:55.065461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:38:55.071562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:55.072071 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:55.072494 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:55.073179 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:55.073736 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:55.074044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:55.215824 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:38:55.224406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:38:55.225904 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:38:55.227116 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8a0a03d7-9892-4868-a6e9-cf25d7c64040 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.166299 Aug 09 11:38:55.227662 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 541/1078] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:38:55 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:38:56.250806 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:56.251519 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:38:56.258460 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:56.258984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:56.259414 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:56.260110 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:56.260558 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:56.260978 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:56.402605 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:38:56.412606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:38:56.414463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:38:56.415813 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-dfe1945f-2ae0-4de9-b96e-3861a7aa4399 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.169492 Aug 09 11:38:56.416380 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 538/1079] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:38:56 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:38:57.440608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:57.441819 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:38:57.452100 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:57.452637 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:57.453066 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:57.453779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:57.454208 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:57.454628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:57.596658 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:38:57.604871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:38:57.606485 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:38:57.607701 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a675d0f8-2fbf-498a-985d-8d1dd8aabfc3 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 200 len: 1724 microversion: 2.20 time: 0.171745 Aug 09 11:38:57.608265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 542/1080] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:38:57 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:38:58.087370 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-9cb1f698-8fb7-45de-a222-7fb8e9c8ba33 req-4de4cb09-9ef2-44c0-9cf5-f3a69baff87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec43b88-6ed9-493d-8ac7-c9b9833dad9d", "name": "network-vif-deleted", "tag": "1e6ec79e-081d-462d-a29f-df7d6f78d422"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:38:58.097636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-9cb1f698-8fb7-45de-a222-7fb8e9c8ba33 req-4de4cb09-9ef2-44c0-9cf5-f3a69baff87a service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:58.098132 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-9cb1f698-8fb7-45de-a222-7fb8e9c8ba33 req-4de4cb09-9ef2-44c0-9cf5-f3a69baff87a service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:58.098542 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-9cb1f698-8fb7-45de-a222-7fb8e9c8ba33 req-4de4cb09-9ef2-44c0-9cf5-f3a69baff87a service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:58.109994 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-9cb1f698-8fb7-45de-a222-7fb8e9c8ba33 req-4de4cb09-9ef2-44c0-9cf5-f3a69baff87a service nova] Creating event network-vif-deleted:1e6ec79e-081d-462d-a29f-df7d6f78d422 for instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d on hv-cinder-84989 Aug 09 11:38:58.115866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-9cb1f698-8fb7-45de-a222-7fb8e9c8ba33 req-4de4cb09-9ef2-44c0-9cf5-f3a69baff87a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031741 Aug 09 11:38:58.119517 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 539/1081] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:38:58.630508 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:58.631313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:38:58.638018 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:58.639234 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:58.639698 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:58.640371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:38:58.641027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:38:58.641420 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:38:58.655610 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] HTTP exception thrown: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Request method failure captured: Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d HTTP/1.1 Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kY69HgsnGk-xukkbljDftBBm2RmzhmYEtaUSgEi-maUHfPl2BJgC9fq2PKz5KGEk9GrNMgQMKQoGfHZRnHGPJmK9WMHO1c0dgGZ8RS5W0PgCewdKoQkgoSfCYTWT8tSQ7a4pT2A5j1Fd0G93jSNin3eijjRUWmn7RlpGnNCP58i9fk Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:38:58.657251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f10ad025e8e405e82f06156adef690e", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 62968629eb0e4ccf8713787d6c4aef5b Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:38:58.659124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': 'dec43b88-6ed9-493d-8ac7-c9b9833dad9d'} Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:38:58.660085 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:38:58.661448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:38:58.663733 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Returning 404 to user: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:38:58.664847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6a98dbd1-8393-4a4d-bc97-3d52911dfa78 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 404 len: 111 microversion: 2.20 time: 0.038499 Aug 09 11:38:58.665422 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 543/1082] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:38:58 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:38:58.676081 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-aa35ccb4-57b0-4219-9723-35327d3b20ef tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '.version_select at 0x7fece24934c0>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:38:58.696086 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-aa35ccb4-57b0-4219-9723-35327d3b20ef tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532724460" status: 204 len: 0 microversion: 2.20 time: 0.025081 Aug 09 11:38:58.696667 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 540/1083] 10.222.0.59 () {60 vars in 1262 bytes} [Tue Aug 9 11:38:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532724460 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 11:38:59.340984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1e030b2e-e7d4-4816-969b-9a0de643e6e5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'create', calling method: .version_select at 0x7fece2e83d30>, body: {"keypair": {"name": "tempest-keypair-1544896733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKje070IQxvrjteAWiGc1TLUZNM/ubnA9inusqC0qeyntMhmouldxmqNqcrUckGOBKo8viXD9JPZMyC7gnHhUzuQMaemFEa5gqXTiB0tNK1j8RBD1F1FZYjYHWtLDI6tXg=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:38:59.356813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-1e030b2e-e7d4-4816-969b-9a0de643e6e5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Getting quotas for project 4f10ad025e8e405e82f06156adef690e. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:38:59.360807 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-1e030b2e-e7d4-4816-969b-9a0de643e6e5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Getting quotas for user 62968629eb0e4ccf8713787d6c4aef5b and project 4f10ad025e8e405e82f06156adef690e. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:38:59.387821 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1e030b2e-e7d4-4816-969b-9a0de643e6e5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050782 Aug 09 11:38:59.388419 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 544/1084] 10.222.0.59 () {62 vars in 1200 bytes} [Tue Aug 9 11:38:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 11:39:00.785808 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-891213105", "imageRef": "f0c5a029-a991-4a19-85f5-1c4d7ec34334", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c92a35cf-69f7-4b18-8b19-cdd4b5aa40f4"}], "security_groups": [{"name": "tempest-securitygroup--2071055857"}], "key_name": "tempest-keypair-1544896733", "user_data": "}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:39:00.896459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.network.neutron [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] validate_networks() for [('c92a35cf-69f7-4b18-8b19-cdd4b5aa40f4', None, None, None, None, None)] {{(pid=117792) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:39:01.434331 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Flavor limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:39:01.434773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Image limits 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:39:01.435278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Flavor pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:39:01.435676 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Image pref 0:0:0 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:39:01.436107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.virt.hardware [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:39:01.445555 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:01.446032 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:01.446493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:01.447240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:01.447692 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:01.448105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:01.466710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Getting quotas for project 4f10ad025e8e405e82f06156adef690e. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:39:01.471016 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Getting quotas for user 62968629eb0e4ccf8713787d6c4aef5b and project 4f10ad025e8e405e82f06156adef690e. Resources: {'ram', 'instances', 'cores'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:39:01.483894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Going to run 1 instances... {{(pid=117792) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:39:01.486539 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0c5a029-a991-4a19-85f5-1c4d7ec34334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:39:01.534191 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [f6658294-03e8-4bda-9f0f-8e7ba8371978] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 11:39:02.542522 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [f6658294-03e8-4bda-9f0f-8e7ba8371978] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51354. Aug 09 11:39:02.546965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a574e6ed-5f6a-4e51-83de-6d7bdf347f66 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.766029 Aug 09 11:39:02.547633 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 541/1085] 10.222.0.59 () {62 vars in 1188 bytes} [Tue Aug 9 11:39:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 11:39:02.559530 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-65be9066-8d2c-4beb-9356-00a90b832503 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:02.560114 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-65be9066-8d2c-4beb-9356-00a90b832503 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:02.615282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-65be9066-8d2c-4beb-9356-00a90b832503 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:02.622990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-65be9066-8d2c-4beb-9356-00a90b832503 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:02.624517 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-65be9066-8d2c-4beb-9356-00a90b832503 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:02.625631 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-65be9066-8d2c-4beb-9356-00a90b832503 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1281 microversion: 2.20 time: 0.070835 Aug 09 11:39:02.626187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 545/1086] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:02 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:03.649251 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:03.649916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:03.657492 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:03.657961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:03.658401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:03.659151 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:03.659602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:03.660023 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:03.726152 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:03.734885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:03.736427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:03.737528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-8f670582-1236-41f7-8c5b-e191fa21dfea tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1333 microversion: 2.20 time: 0.093216 Aug 09 11:39:03.750097 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 542/1087] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:03 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:04.760674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:04.761283 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:04.768259 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:04.768794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:04.769190 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:04.769872 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:04.770357 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:04.770787 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:04.908315 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:04.917045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:04.918550 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:04.919699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-361b909f-ac6e-4a4d-9109-279f83f2f602 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1407 microversion: 2.20 time: 0.163202 Aug 09 11:39:04.920281 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 546/1088] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:04 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:05.119010 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-b857b733-0348-4e0b-bfc0-c73695ec539c req-bc351ddf-d206-44b0-ad62-9222a405582e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1219d54a-bde0-49d0-baba-4d67aa8f8d0c", "tag": "46f2505c-37b4-443e-ad81-86126ca0c81e"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:39:05.129861 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b857b733-0348-4e0b-bfc0-c73695ec539c req-bc351ddf-d206-44b0-ad62-9222a405582e service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:05.130331 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b857b733-0348-4e0b-bfc0-c73695ec539c req-bc351ddf-d206-44b0-ad62-9222a405582e service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:05.130760 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b857b733-0348-4e0b-bfc0-c73695ec539c req-bc351ddf-d206-44b0-ad62-9222a405582e service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:05.145145 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-b857b733-0348-4e0b-bfc0-c73695ec539c req-bc351ddf-d206-44b0-ad62-9222a405582e service nova] Creating event network-changed:46f2505c-37b4-443e-ad81-86126ca0c81e for instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c on hv-cinder-84989 Aug 09 11:39:05.150937 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-b857b733-0348-4e0b-bfc0-c73695ec539c req-bc351ddf-d206-44b0-ad62-9222a405582e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035568 Aug 09 11:39:05.151795 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 543/1089] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 11:39:05.941754 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:05.942366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:05.948943 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:05.949421 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:05.949915 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:05.950608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:05.951097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:05.951495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:06.092355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:06.100485 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:06.101957 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:06.103081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b5f91c5f-b22d-49b2-a703-b66fbc345dc4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1407 microversion: 2.20 time: 0.165339 Aug 09 11:39:06.103652 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 547/1090] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:05 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:07.130188 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:07.131164 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:07.140628 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:07.141320 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:07.142006 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:07.142931 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:07.143635 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:07.144256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:07.286465 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:07.294730 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:07.296266 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:07.297405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1fbcb943-cbee-4e5e-99b7-f581a0b46f77 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1407 microversion: 2.20 time: 0.174540 Aug 09 11:39:07.297965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 544/1091] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:07 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:08.323645 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:08.324327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:08.332795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:08.333257 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:08.333686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:08.334433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:08.334918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:08.335327 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:08.502057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:08.510083 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:08.511623 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:08.512714 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5d23e415-ab2a-41e9-8790-1bf14cdfff3b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1407 microversion: 2.20 time: 0.193227 Aug 09 11:39:08.513267 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 548/1092] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:08 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:09.540007 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:09.540849 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:09.552336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:09.553131 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:09.553817 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:09.555096 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:09.555901 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:09.556657 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:09.706412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:09.718706 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:09.721177 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:09.722935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1faa536f-5618-4233-8365-543501a29750 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1407 microversion: 2.20 time: 0.190161 Aug 09 11:39:09.723798 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 545/1093] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:09 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:10.746015 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:10.746752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:10.753811 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:10.754343 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:10.754782 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:10.755558 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:10.756017 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:10.756557 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:10.889009 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:10.897604 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:10.899154 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:10.900276 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8fa90edd-51d7-4a3d-99b3-46c2ffc17183 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1407 microversion: 2.20 time: 0.158368 Aug 09 11:39:10.900848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 549/1094] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:10 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:11.924781 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:11.925405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:11.927972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:39:11.928557 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=6 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:39:11.934756 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:11.935273 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:11.935708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:11.936399 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:11.936849 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:11.937269 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:12.076610 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:12.085152 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:12.086655 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:12.087786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ae8dfcf1-0b72-43a4-9301-a38d6493662d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1407 microversion: 2.20 time: 0.167678 Aug 09 11:39:12.088359 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 546/1095] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:11 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:12.793140 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:39:12.917634 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e87e00a7-87a3-40ea-851e-8ee0aee65db2 req-0b035776-ab6e-4877-967c-b6d4b4a958f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1219d54a-bde0-49d0-baba-4d67aa8f8d0c", "name": "network-vif-plugged", "status": "completed", "tag": "46f2505c-37b4-443e-ad81-86126ca0c81e"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:39:12.927562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e87e00a7-87a3-40ea-851e-8ee0aee65db2 req-0b035776-ab6e-4877-967c-b6d4b4a958f1 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:12.927958 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e87e00a7-87a3-40ea-851e-8ee0aee65db2 req-0b035776-ab6e-4877-967c-b6d4b4a958f1 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:12.928387 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e87e00a7-87a3-40ea-851e-8ee0aee65db2 req-0b035776-ab6e-4877-967c-b6d4b4a958f1 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:12.940574 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e87e00a7-87a3-40ea-851e-8ee0aee65db2 req-0b035776-ab6e-4877-967c-b6d4b4a958f1 service nova] Creating event network-vif-plugged:46f2505c-37b4-443e-ad81-86126ca0c81e for instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c on hv-cinder-84989 Aug 09 11:39:12.946057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e87e00a7-87a3-40ea-851e-8ee0aee65db2 req-0b035776-ab6e-4877-967c-b6d4b4a958f1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158056 Aug 09 11:39:12.946657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 550/1096] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:39:13.109756 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:13.110378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:13.117336 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:13.117831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:13.118254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:13.118994 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:13.119658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:13.119830 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:13.255937 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:13.264414 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:13.266046 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:13.267190 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ed937722-a679-468d-b948-4246bb05c8f8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1407 microversion: 2.20 time: 0.161435 Aug 09 11:39:13.267750 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 547/1097] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:13 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:14.290797 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:14.291520 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:14.298160 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:14.298652 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:14.299117 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:14.299832 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:14.300293 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:14.300719 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:14.444166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:14.452575 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:14.454115 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:14.455249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aee0ede3-4b9a-4d12-97b0-207165400019 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1407 microversion: 2.20 time: 0.169360 Aug 09 11:39:14.456128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 551/1098] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:14 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:15.478261 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:15.478777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:15.485466 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:15.485954 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:15.486389 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:15.487108 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:15.487561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:15.487998 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:15.627166 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:15.635138 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:15.636622 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:39:15.637768 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a21bbc3a-aebe-4437-93be-d6bb9a6fc8b4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1600 microversion: 2.20 time: 0.163594 Aug 09 11:39:15.638320 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 548/1099] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:39:15 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:39:15.660080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-75608a4b-7aeb-4ef1-a5c6-68fe152b0f67 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:39:15.660646 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-75608a4b-7aeb-4ef1-a5c6-68fe152b0f67 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:39:15.667813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75608a4b-7aeb-4ef1-a5c6-68fe152b0f67 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:15.668311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75608a4b-7aeb-4ef1-a5c6-68fe152b0f67 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:15.668746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75608a4b-7aeb-4ef1-a5c6-68fe152b0f67 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:15.669451 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75608a4b-7aeb-4ef1-a5c6-68fe152b0f67 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:15.669914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75608a4b-7aeb-4ef1-a5c6-68fe152b0f67 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:15.670340 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-75608a4b-7aeb-4ef1-a5c6-68fe152b0f67 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:15.754283 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-75608a4b-7aeb-4ef1-a5c6-68fe152b0f67 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098263 Aug 09 11:39:15.754898 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 552/1100] 10.222.0.59 () {60 vars in 1316 bytes} [Tue Aug 9 11:39:15 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:39:16.754328 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-44e3b273-f1a2-463b-be9a-6e7a2643b5e3 req-70ab779f-4a02-4a17-ab14-6f40455af9ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1219d54a-bde0-49d0-baba-4d67aa8f8d0c", "tag": "46f2505c-37b4-443e-ad81-86126ca0c81e"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:39:16.764203 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-44e3b273-f1a2-463b-be9a-6e7a2643b5e3 req-70ab779f-4a02-4a17-ab14-6f40455af9ac service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:39:16.765347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-44e3b273-f1a2-463b-be9a-6e7a2643b5e3 req-70ab779f-4a02-4a17-ab14-6f40455af9ac service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:39:16.765347 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-44e3b273-f1a2-463b-be9a-6e7a2643b5e3 req-70ab779f-4a02-4a17-ab14-6f40455af9ac service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:39:16.776021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-44e3b273-f1a2-463b-be9a-6e7a2643b5e3 req-70ab779f-4a02-4a17-ab14-6f40455af9ac service nova] Creating event network-changed:46f2505c-37b4-443e-ad81-86126ca0c81e for instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c on hv-cinder-84989 Aug 09 11:39:16.781268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-44e3b273-f1a2-463b-be9a-6e7a2643b5e3 req-70ab779f-4a02-4a17-ab14-6f40455af9ac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030622 Aug 09 11:39:16.782098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 549/1101] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:39:22.265693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:39:22.266393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:40:31.702372 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:40:31.703138 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:40:31.758849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-60180031-162c-4e8f-a563-0062ae317c58 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:31.759371 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-60180031-162c-4e8f-a563-0062ae317c58 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:31.765521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60180031-162c-4e8f-a563-0062ae317c58 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:31.766005 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60180031-162c-4e8f-a563-0062ae317c58 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:31.766438 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60180031-162c-4e8f-a563-0062ae317c58 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:31.767273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60180031-162c-4e8f-a563-0062ae317c58 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:31.767728 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60180031-162c-4e8f-a563-0062ae317c58 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:31.768155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-60180031-162c-4e8f-a563-0062ae317c58 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:31.792382 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-60180031-162c-4e8f-a563-0062ae317c58 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/ips" status: 200 len: 153 microversion: 2.20 time: 0.091914 Aug 09 11:40:31.792949 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 553/1102] 10.222.0.59 () {60 vars in 1289 bytes} [Tue Aug 9 11:40:31 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/ips => generated 153 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:40:33.589006 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:40:33.589741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:40:33.595003 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:40:33.595742 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:33.603444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:33.603922 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:33.604362 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:33.605047 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:33.605499 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:33.605926 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:33.632645 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.objects.instance [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lazy-loading 'flavor' on Instance uuid 1219d54a-bde0-49d0-baba-4d67aa8f8d0c {{(pid=117792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 11:40:33.840658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-84fcfdaa-2f0b-408d-98a3-d0ab38a54785 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/action" status: 202 len: 0 microversion: 2.20 time: 0.254149 Aug 09 11:40:33.841170 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 550/1103] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 9 11:40:33 2022] POST /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:40:33.849779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:33.850415 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:33.857292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:33.857813 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:33.858273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:33.859057 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:33.859558 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:33.860236 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:33.989610 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:33.997648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:33.999168 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:34.000317 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-716b20b4-1c30-45fb-8abd-f3aae328db5d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.154693 Aug 09 11:40:34.000863 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 554/1104] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:33 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:35.024943 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:35.025579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:35.032607 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:35.033208 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:35.033644 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:35.034348 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:35.034800 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:35.035273 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:35.183850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:35.194212 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:35.195729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:35.196883 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e7564f76-b10c-4ba5-b290-9b4b72f74c54 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.176921 Aug 09 11:40:35.197440 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 551/1105] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:35 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:36.223229 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:36.224003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:36.232573 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:36.233214 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:36.233778 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:36.234686 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:36.235311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:36.235868 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:36.370895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:36.381825 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:36.383361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:36.384520 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-603b235f-8813-4245-a610-b59ec7a23095 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.167378 Aug 09 11:40:36.385118 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 555/1106] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:36 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:37.411310 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:37.411912 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:37.418620 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:37.419132 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:37.419561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:37.420244 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:37.420682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:37.421096 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:37.556286 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:37.568324 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:37.570547 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:37.572240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-eb7133b9-a6fa-40db-99fb-28c9c6cd4e8d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.165864 Aug 09 11:40:37.573021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 552/1107] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:37 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:38.596252 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:38.596863 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:38.603591 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:38.604070 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:38.604503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:38.605198 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:38.605653 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:38.606080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:38.739169 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:38.747595 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:38.749115 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:38.750271 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-057d1ce0-8eb6-4557-a5d1-5fa9964e9631 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.158156 Aug 09 11:40:38.750842 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 556/1108] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:38 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:39.776973 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:39.777841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:39.785667 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:39.786111 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:39.786634 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:39.788134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:39.788134 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:39.788857 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:39.929548 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:39.938240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:39.939797 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:39.940945 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c538865f-d9f0-4036-9e20-5cc9bc7d92d6 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.170048 Aug 09 11:40:39.941543 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 553/1109] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:39 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:40.971243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:40.971860 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:40.978848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:40.979375 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:40.979806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:40.980495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:40.980945 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:40.981361 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:41.129570 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:41.137518 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:41.139035 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:41.140192 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3470bc46-7af9-44a4-b2cd-13bbaca34683 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.173335 Aug 09 11:40:41.140753 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 557/1110] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:40 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:42.170243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:42.170896 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:42.177812 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:42.178299 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:42.178726 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:42.179458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:42.179903 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:42.180319 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:42.312754 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:42.320923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:42.322359 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:42.323549 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-5f2fd3ee-e232-44ac-987f-6422571305b1 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.157328 Aug 09 11:40:42.324106 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 554/1111] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:42 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:43.348044 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:43.348646 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:43.355420 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:43.355906 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:43.356338 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:43.357030 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:43.357460 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:43.357915 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:43.489462 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:43.501749 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:43.504197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:43.505491 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-58e5e653-6c86-4e75-a694-85ef8b4c07b7 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.161552 Aug 09 11:40:43.506053 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 558/1112] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:43 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:44.528764 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:44.529366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:44.536192 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:44.536668 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:44.537090 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:44.537774 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:44.538216 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:44.538629 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:44.683558 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:44.691718 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:44.693334 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:44.694510 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9f4b18b0-7294-47b6-80e8-249a85bcda5b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.169686 Aug 09 11:40:44.695073 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 555/1113] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:44 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:45.727095 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:45.727758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:45.734723 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:45.735249 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:45.735682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:45.736391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:45.736847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:45.737272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:45.881793 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:45.890218 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:45.891766 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:45.892937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3a58d75f-7690-4ba9-b52a-cccb957b6c55 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1746 microversion: 2.20 time: 0.170072 Aug 09 11:40:45.893532 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 559/1114] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:45 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:46.917870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:46.918467 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:46.925410 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:46.925893 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:46.926331 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:46.927109 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:46.927564 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:46.927986 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:47.070268 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:47.079057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:47.080906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:47.082075 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6d64fca2-2185-4f4c-9234-bdbbfe38d17e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1746 microversion: 2.20 time: 0.168205 Aug 09 11:40:47.082611 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 556/1115] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:46 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:48.112193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:48.112870 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:48.119795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:48.120253 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:48.120684 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:48.121384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:48.121835 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:48.122257 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:48.261817 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:48.270065 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:48.271752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:48.272934 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7a467858-b562-441e-bab8-788bd7c872db tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1746 microversion: 2.20 time: 0.165048 Aug 09 11:40:48.273715 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 560/1116] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:48 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:49.303737 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:49.304303 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:49.311227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:49.311715 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:49.312155 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:49.312833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:49.313282 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:49.313707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:49.394651 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-67bec838-8157-4a9a-a52d-9934e770b316 req-e66cbc47-d5bb-4df5-a8ac-8ddd9146bea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1219d54a-bde0-49d0-baba-4d67aa8f8d0c", "name": "network-vif-plugged", "status": "completed", "tag": "46f2505c-37b4-443e-ad81-86126ca0c81e"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:40:49.406021 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-67bec838-8157-4a9a-a52d-9934e770b316 req-e66cbc47-d5bb-4df5-a8ac-8ddd9146bea9 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:49.407130 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-67bec838-8157-4a9a-a52d-9934e770b316 req-e66cbc47-d5bb-4df5-a8ac-8ddd9146bea9 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:49.407130 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-67bec838-8157-4a9a-a52d-9934e770b316 req-e66cbc47-d5bb-4df5-a8ac-8ddd9146bea9 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:49.420545 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-67bec838-8157-4a9a-a52d-9934e770b316 req-e66cbc47-d5bb-4df5-a8ac-8ddd9146bea9 service nova] Creating event network-vif-plugged:46f2505c-37b4-443e-ad81-86126ca0c81e for instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c on hv-cinder-84989 Aug 09 11:40:49.425963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-67bec838-8157-4a9a-a52d-9934e770b316 req-e66cbc47-d5bb-4df5-a8ac-8ddd9146bea9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035310 Aug 09 11:40:49.426758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 561/1117] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:40:49.449393 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:49.458403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:49.464296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:49.464296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4ce48b8b-0093-4b0c-bbb1-48999daf31c5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1746 microversion: 2.20 time: 0.163847 Aug 09 11:40:49.464748 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 557/1118] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:49 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:50.492642 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:50.494093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:50.500737 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:50.501441 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:50.502045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:50.502962 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:50.503705 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:50.504323 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:50.651404 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:50.663566 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:50.665385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:50.667192 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-adbc78b2-d19e-469c-adb4-755d1874a153 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1741 microversion: 2.20 time: 0.179257 Aug 09 11:40:50.668213 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 562/1119] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:50 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:51.691425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:51.692327 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:51.699253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:51.700034 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:51.700511 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:51.701215 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:51.701662 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:51.702078 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:51.838624 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:51.847287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:51.848839 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:51.850228 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a061105c-6f44-4a8e-990c-3290facbe9f2 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1741 microversion: 2.20 time: 0.162766 Aug 09 11:40:51.850787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 558/1120] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:51 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:52.875148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:52.875799 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:52.884041 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:52.884530 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:52.884965 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:52.885651 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:52.886097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:52.886519 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:53.359343 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:53.368385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:53.370660 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:53.372303 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c0eef8f6-6561-44d0-9a20-9e8e06eb0240 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1741 microversion: 2.20 time: 0.502120 Aug 09 11:40:53.372923 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 563/1121] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:52 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1741 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:54.396378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:54.396965 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:54.410951 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:54.411489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:54.411904 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:54.412609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:54.413058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:54.413463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:54.553937 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:54.565749 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:54.567277 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:54.568508 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4ad06ac7-4ccc-4d5b-b8df-67913f13f770 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1741 microversion: 2.20 time: 0.176322 Aug 09 11:40:54.569527 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 559/1122] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:54 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:55.595188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:55.595747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:55.602168 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:55.602690 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:55.603122 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:55.603867 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:55.604311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:55.604724 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:55.746432 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:55.755320 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:55.756851 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:55.758156 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-03d1f043-ce19-4c13-9d72-8f5a1d93f8d4 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1741 microversion: 2.20 time: 0.169391 Aug 09 11:40:55.758713 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 564/1123] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:55 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:56.782014 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:56.782676 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:56.789723 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:56.790225 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:56.790746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:56.791560 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:56.791933 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:56.792415 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:56.930540 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:56.939570 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:56.941076 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:56.942243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0254407d-0196-44fc-a6b2-ae25e9b5c91e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1741 microversion: 2.20 time: 0.164376 Aug 09 11:40:56.942910 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 560/1124] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:56 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:57.966340 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:57.967003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:57.974118 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:57.974603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:57.975083 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:57.975815 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:57.976275 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:57.976702 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:58.138135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:58.149067 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:58.151048 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:58.151900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fd13a9fb-3297-4f68-918d-e151d1d94e7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1741 microversion: 2.20 time: 0.190053 Aug 09 11:40:58.152548 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 565/1125] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:57 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:40:59.194203 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:40:59.194783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:40:59.201599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:59.202327 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:59.202774 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:59.203501 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:40:59.203960 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:40:59.204391 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:40:59.352111 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:59.360158 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:59.361656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:40:59.362834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7bb3bf30-16c7-47fc-960e-7bc011dceafc tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1741 microversion: 2.20 time: 0.174391 Aug 09 11:40:59.363404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 561/1126] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:40:59 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:00.386121 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:00.386726 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:00.393603 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:00.394107 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:00.394534 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:00.395260 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:00.395717 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:00.396142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:00.531292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:00.540855 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:00.542367 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:00.543563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2cb0075f-3a59-4b81-847f-a6d2fc91aa0b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1723 microversion: 2.20 time: 0.161517 Aug 09 11:41:00.544173 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 566/1127] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:00 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:01.578413 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:01.579256 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:01.587167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:01.587639 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:01.588063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:01.588743 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:01.589190 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:01.589589 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:01.740741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:01.751686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:01.754133 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:01.755957 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-88c16d32-63c9-4698-be37-2f98cf896e2c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1723 microversion: 2.20 time: 0.182976 Aug 09 11:41:01.756773 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 562/1128] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:01 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:02.785817 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:02.786445 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:02.789053 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=29 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:41:02.794710 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:02.795212 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:02.795642 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:02.796331 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:02.796781 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:02.797191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:02.799914 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=79 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:41:02.935539 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:02.944082 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:02.945592 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:02.946755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9bb76859-42ba-4f38-8aed-6dee76c8ecca tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1666 microversion: 2.20 time: 0.165027 Aug 09 11:41:02.947514 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 567/1129] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:02 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:02.970208 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f144c0ae-1ca4-414c-bd5d-62d8f734f03b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b782666-9056-4381-bd3e-4fd43f002b46"}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:41:02.972554 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f144c0ae-1ca4-414c-bd5d-62d8f734f03b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:02.979738 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f144c0ae-1ca4-414c-bd5d-62d8f734f03b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:02.980227 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f144c0ae-1ca4-414c-bd5d-62d8f734f03b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:02.980661 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f144c0ae-1ca4-414c-bd5d-62d8f734f03b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:02.981359 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f144c0ae-1ca4-414c-bd5d-62d8f734f03b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:02.981810 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f144c0ae-1ca4-414c-bd5d-62d8f734f03b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:02.982226 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f144c0ae-1ca4-414c-bd5d-62d8f734f03b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:03.171042 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:41:03.300712 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f144c0ae-1ca4-414c-bd5d-62d8f734f03b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.334197 Aug 09 11:41:03.301632 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 563/1130] 10.222.0.59 () {62 vars in 1364 bytes} [Tue Aug 9 11:41:02 2022] POST /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 11:41:03.428398 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9fa98c82-e331-477a-96b9-f85a5409c39d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:03.428994 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9fa98c82-e331-477a-96b9-f85a5409c39d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:03.435319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa98c82-e331-477a-96b9-f85a5409c39d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:03.435796 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa98c82-e331-477a-96b9-f85a5409c39d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:03.436218 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa98c82-e331-477a-96b9-f85a5409c39d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:03.436916 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa98c82-e331-477a-96b9-f85a5409c39d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:03.437374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa98c82-e331-477a-96b9-f85a5409c39d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:03.437815 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9fa98c82-e331-477a-96b9-f85a5409c39d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:03.489947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-1e886aed-edce-48ef-a6cd-1a7f003b447c req-d12d5deb-47dc-44cc-a810-4e25aa4e9264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1219d54a-bde0-49d0-baba-4d67aa8f8d0c", "name": "network-vif-unplugged", "status": "completed", "tag": "46f2505c-37b4-443e-ad81-86126ca0c81e"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:41:03.503207 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-1e886aed-edce-48ef-a6cd-1a7f003b447c req-d12d5deb-47dc-44cc-a810-4e25aa4e9264 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:03.504296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-1e886aed-edce-48ef-a6cd-1a7f003b447c req-d12d5deb-47dc-44cc-a810-4e25aa4e9264 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:03.504732 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-1e886aed-edce-48ef-a6cd-1a7f003b447c req-d12d5deb-47dc-44cc-a810-4e25aa4e9264 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:03.520514 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.compute.server_external_events [req-1e886aed-edce-48ef-a6cd-1a7f003b447c req-d12d5deb-47dc-44cc-a810-4e25aa4e9264 service nova] Unable to find a host for instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c. Dropping event network-vif-unplugged {{(pid=117792) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 11:41:03.522011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-1e886aed-edce-48ef-a6cd-1a7f003b447c req-d12d5deb-47dc-44cc-a810-4e25aa4e9264 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037680 Aug 09 11:41:03.522576 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 564/1131] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 11:41:03.711380 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9fa98c82-e331-477a-96b9-f85a5409c39d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/os-volume_attachments/5b782666-9056-4381-bd3e-4fd43f002b46" status: 202 len: 0 microversion: 2.20 time: 0.287055 Aug 09 11:41:03.712097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 568/1132] 10.222.0.59 () {60 vars in 1457 bytes} [Tue Aug 9 11:41:03 2022] DELETE /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/os-volume_attachments/5b782666-9056-4381-bd3e-4fd43f002b46 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 11:41:03.773390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:41:03.773996 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:03.775897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=31 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:41:03.781553 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:03.782008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:03.782419 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:03.783144 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:03.783592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:03.784009 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:03.819668 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117792) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 11:41:03.899837 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a01517ae-dd53-4108-9305-48d26854a85d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "POST /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/action" status: 202 len: 0 microversion: 2.20 time: 0.130571 Aug 09 11:41:03.900444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 565/1133] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 9 11:41:03 2022] POST /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:41:03.908776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:03.909451 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:03.917003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:03.917487 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:03.917917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:03.918735 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:03.919259 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:03.919677 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:04.052256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:04.060362 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:04.061844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:04.063026 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-95c04d2b-614c-4efa-a701-e3fdd01bf9e9 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1674 microversion: 2.20 time: 0.158234 Aug 09 11:41:04.063549 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 569/1134] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:03 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:05.087150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:05.087854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:05.094485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:05.095011 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:05.095428 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:05.096133 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:05.096582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:05.097002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:05.246438 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:05.256101 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:05.258160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:05.259366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1a8f83eb-5d87-4209-a1e4-b2e23f1cc951 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.177272 Aug 09 11:41:05.260043 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 566/1135] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:05 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:06.288265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:06.289528 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:06.296878 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:06.297753 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:06.298493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:06.299318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:06.299847 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:06.300355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:06.500819 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:06.511878 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:06.513526 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:06.515007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-82ff25fe-ba1b-4f73-b666-29e4a8914a3d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.233187 Aug 09 11:41:06.518860 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 570/1136] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:06 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:07.538447 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:07.539873 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:07.547008 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:07.547863 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:07.548528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:07.549487 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:07.550267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:07.550956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:07.692813 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:07.701687 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:07.703249 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:07.704437 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-605fc4c0-b2f0-4458-bd0f-100413e5d2fa tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.170031 Aug 09 11:41:07.705294 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 567/1137] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:07 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:08.728744 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:08.729309 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:08.735841 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:08.736352 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:08.736789 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:08.737478 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:08.737934 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:08.738363 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:08.889854 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:08.898479 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:08.900592 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:08.902166 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3d842ba3-c11a-4c28-a189-f58b2e4db636 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.177682 Aug 09 11:41:08.903030 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 571/1138] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:08 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:09.926223 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:09.927936 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:09.935084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:09.935568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:09.936002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:09.936707 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:09.937167 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:09.937591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:10.131814 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:10.141855 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:10.143400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:10.144754 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e4909783-8dcf-4256-8c4f-3047102c2aac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.222652 Aug 09 11:41:10.145494 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 568/1139] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:09 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:11.169041 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:11.169667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:11.178027 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:11.179251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:11.179251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:11.179794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:11.180558 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:11.180558 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:11.392608 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:11.400981 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:11.402670 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:11.405273 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-43979f71-3485-4b2f-88f0-db5f739f2b7f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.238774 Aug 09 11:41:11.416448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 572/1140] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:11 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:12.438127 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:12.438741 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:12.446652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:12.447176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:12.447613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:12.448329 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:12.448782 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:12.449500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:12.598916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:12.606990 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:12.608525 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:12.609785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-59b0dbfb-ad99-47df-9993-a40cb8d8db79 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.175540 Aug 09 11:41:12.610592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 569/1141] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:12 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:13.635563 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:13.636385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:13.645760 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:13.646272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:13.646695 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:13.647423 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:13.647882 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:13.648300 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:13.794771 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:13.803565 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:13.804990 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:13.806137 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-592230fd-2675-4b0c-83bc-dbd77ef1bc5e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.176877 Aug 09 11:41:13.806661 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 573/1142] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:13 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:14.829779 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:14.830737 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:14.837877 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:14.838372 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:14.838847 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:14.839556 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:14.840023 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:14.840458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:14.980683 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:14.988814 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:14.990415 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:14.991596 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cd5b65a5-11bd-4ee6-8883-1c93e4445718 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.165995 Aug 09 11:41:14.992145 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 570/1143] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:14 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:16.022551 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:16.023165 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:16.030392 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:16.030907 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:16.031331 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:16.032036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:16.032469 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:16.032892 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:16.168502 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:16.181487 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:16.183895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:16.185627 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a7b8452d-000d-4991-a030-f5c86f825327 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.166930 Aug 09 11:41:16.186431 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 574/1144] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:16 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:17.211510 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:17.212136 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:17.218860 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:17.219377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:17.219792 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:17.220494 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:17.220943 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:17.221358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:17.361317 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:17.369828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:17.371385 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:17.372517 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a74c8d5a-222e-4686-b049-a86081abef7d tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.165041 Aug 09 11:41:17.373083 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 571/1145] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:17 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:18.395900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:18.396517 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:18.403586 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:18.404075 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:18.404607 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:18.405222 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:18.405683 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:18.406099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:18.551038 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:18.559635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:18.561258 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:18.562440 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1648e2cd-a37f-46da-b294-664e33034743 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.170608 Aug 09 11:41:18.563028 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 575/1146] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:18 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:19.586165 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:19.586794 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:19.594005 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:19.594566 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:19.595093 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:19.595859 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:19.596306 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:19.596728 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:19.729802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:19.738943 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:19.740804 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:19.742089 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-cdc6be4a-ec4c-4bb8-b5f4-551e7f6d6f20 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.160251 Aug 09 11:41:19.742528 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 572/1147] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:19 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:20.769182 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:20.770069 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:20.780794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:20.781585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:20.782274 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:20.783474 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:20.784220 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:20.784906 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:20.939190 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:20.947239 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:20.948748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:20.949938 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-862be7ac-c6a1-4d80-b2d8-d6a3d95d541c tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.187455 Aug 09 11:41:20.950498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 576/1148] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:20 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:21.575991 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-4fa11545-16f1-4993-888a-0b1d2e56cb5a req-9f59855c-6f9d-4ce8-87b3-cea095d3e4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1219d54a-bde0-49d0-baba-4d67aa8f8d0c", "name": "network-vif-plugged", "status": "completed", "tag": "46f2505c-37b4-443e-ad81-86126ca0c81e"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:41:21.588481 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4fa11545-16f1-4993-888a-0b1d2e56cb5a req-9f59855c-6f9d-4ce8-87b3-cea095d3e4a3 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:21.589102 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4fa11545-16f1-4993-888a-0b1d2e56cb5a req-9f59855c-6f9d-4ce8-87b3-cea095d3e4a3 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:21.589543 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4fa11545-16f1-4993-888a-0b1d2e56cb5a req-9f59855c-6f9d-4ce8-87b3-cea095d3e4a3 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:21.600855 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-4fa11545-16f1-4993-888a-0b1d2e56cb5a req-9f59855c-6f9d-4ce8-87b3-cea095d3e4a3 service nova] Creating event network-vif-plugged:46f2505c-37b4-443e-ad81-86126ca0c81e for instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c on hv-cinder-84989 Aug 09 11:41:21.606102 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-4fa11545-16f1-4993-888a-0b1d2e56cb5a req-9f59855c-6f9d-4ce8-87b3-cea095d3e4a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033711 Aug 09 11:41:21.606703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 573/1149] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:41:21.982144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:21.982954 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:21.991696 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:21.992184 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:21.992621 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:21.993325 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:21.993786 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:21.994217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:22.134662 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:22.145804 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:22.148255 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:22.150128 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ff8c9967-d65b-43d4-8e8e-90a1f9692365 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.173127 Aug 09 11:41:22.150960 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 577/1150] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:21 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:23.182867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:23.183952 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:23.193299 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:23.193802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:23.194236 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:23.194972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:23.195427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:23.195848 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:23.330547 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:23.339196 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:23.340687 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:23.341833 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f174e598-f20a-4e53-963e-d6acb428a40b tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1732 microversion: 2.20 time: 0.166595 Aug 09 11:41:23.342393 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 574/1151] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:23 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:41:24.365132 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:41:24.365751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:41:24.372764 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:24.373213 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:24.373766 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:24.374468 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:41:24.375019 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:41:24.375467 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:41:24.506278 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:24.514577 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:24.516115 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:41:24.519927 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a102fe7e-677b-4c63-a5f3-2041e5337641 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1719 microversion: 2.20 time: 0.158934 Aug 09 11:41:24.520504 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 578/1152] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:41:24 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:42:03.969718 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:42:03.970550 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:42:19.941512 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9584a1c6-4e2b-44a1-b4ae-9396b6493052 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:19.943680 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9584a1c6-4e2b-44a1-b4ae-9396b6493052 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:19.945802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:19.946448 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:19.953699 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9584a1c6-4e2b-44a1-b4ae-9396b6493052 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:19.954690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9584a1c6-4e2b-44a1-b4ae-9396b6493052 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:19.955232 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9584a1c6-4e2b-44a1-b4ae-9396b6493052 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:19.956312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9584a1c6-4e2b-44a1-b4ae-9396b6493052 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:19.956927 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9584a1c6-4e2b-44a1-b4ae-9396b6493052 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:19.957601 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9584a1c6-4e2b-44a1-b4ae-9396b6493052 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:19.989695 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9584a1c6-4e2b-44a1-b4ae-9396b6493052 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052339 Aug 09 11:42:19.990246 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 575/1153] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 11:42:19 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:42:20.061498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:20.062073 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:20.064072 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=23 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:20.064712 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:42:20.071268 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:20.071745 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:20.072173 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:20.072884 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:20.073314 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:20.073963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:20.101059 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:42:20.183370 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4b9a79c9-e41d-42bd-a219-cc3f0b8f14b5 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 204 len: 0 microversion: 2.20 time: 0.126613 Aug 09 11:42:20.184221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 579/1154] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 9 11:42:20 2022] DELETE /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 11:42:20.199852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:20.200728 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:20.208429 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:20.209396 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:20.210026 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:20.211353 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:20.211811 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:20.212239 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:20.369635 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:42:20.381609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:42:20.383871 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:42:20.385586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-567fa232-de69-4f29-b74f-749385d7f484 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.194848 Aug 09 11:42:20.386369 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 576/1155] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:42:20 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:42:21.409370 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:21.410007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:21.417188 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:21.417665 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:21.418123 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:21.419403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:21.419848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:21.420270 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:21.560657 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:42:21.569002 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:42:21.570550 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:42:21.571748 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0634b42e-24cb-4809-a1ce-fb0be24c6a63 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1725 microversion: 2.20 time: 0.166753 Aug 09 11:42:21.572318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 580/1156] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:42:21 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 11:42:22.596799 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:22.598019 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:22.605649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:22.606400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:22.606854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:22.607582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:22.608049 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:22.608456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:22.673652 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:42:22.682270 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:42:22.684063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62968629eb0e4ccf8713787d6c4aef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f10ad025e8e405e82f06156adef690e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:42:22.685307 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f6679ac0-c2f2-421d-b1e9-3aa3cde7ed9e tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 200 len: 1657 microversion: 2.20 time: 0.093448 Aug 09 11:42:22.686342 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 577/1157] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:42:22 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 1657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 11:42:22.766279 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-a7afc1d8-6467-49f4-985e-1e735dbf163d req-26c2d237-dcbb-46f3-af75-9fb9ed5b08ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1219d54a-bde0-49d0-baba-4d67aa8f8d0c", "name": "network-vif-deleted", "tag": "46f2505c-37b4-443e-ad81-86126ca0c81e"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:42:22.783265 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a7afc1d8-6467-49f4-985e-1e735dbf163d req-26c2d237-dcbb-46f3-af75-9fb9ed5b08ce service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:22.784366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a7afc1d8-6467-49f4-985e-1e735dbf163d req-26c2d237-dcbb-46f3-af75-9fb9ed5b08ce service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:22.785560 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a7afc1d8-6467-49f4-985e-1e735dbf163d req-26c2d237-dcbb-46f3-af75-9fb9ed5b08ce service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:22.801024 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-a7afc1d8-6467-49f4-985e-1e735dbf163d req-26c2d237-dcbb-46f3-af75-9fb9ed5b08ce service nova] Creating event network-vif-deleted:46f2505c-37b4-443e-ad81-86126ca0c81e for instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c on hv-cinder-84989 Aug 09 11:42:22.806383 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-a7afc1d8-6467-49f4-985e-1e735dbf163d req-26c2d237-dcbb-46f3-af75-9fb9ed5b08ce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121014 Aug 09 11:42:22.807115 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 581/1158] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:42:23.710349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:23.711499 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:23.718582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:23.719140 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:23.719573 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:23.720283 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:23.720703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:23.721413 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:23.736895 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] HTTP exception thrown: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Request method failure captured: Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c HTTP/1.1 Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kY69HgsnGk-xukkbljDftBBm2RmzhmYEtaUSgEi-maUHfPl2BJgC9fq2PKz5KGEk9GrNMgQMKQoGfHZRnHGPJmK9WMHO1c0dgGZ8RS5W0PgCewdKoQkgoSfCYTWT8tSQ7a4pT2A5j1Fd0G93jSNin3eijjRUWmn7RlpGnNCP58i9fk Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:42:23.738956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f10ad025e8e405e82f06156adef690e", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 62968629eb0e4ccf8713787d6c4aef5b Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:23.740638 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '1219d54a-bde0-49d0-baba-4d67aa8f8d0c'} Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:42:23.741602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:23.743193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:23.744458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Returning 404 to user: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:42:23.744458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-894e828b-9878-4add-adce-78d30c673550 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 404 len: 111 microversion: 2.20 time: 0.033801 Aug 09 11:42:23.744458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 578/1159] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:42:23 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:42:23.754165 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d57849e8-bf6c-4429-8136-dda3af99f20f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '.version_select at 0x7fece6eb1550>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:23.778794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d57849e8-bf6c-4429-8136-dda3af99f20f tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544896733" status: 204 len: 0 microversion: 2.20 time: 0.029586 Aug 09 11:42:23.779468 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 582/1160] 10.222.0.59 () {60 vars in 1262 bytes} [Tue Aug 9 11:42:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544896733 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 11:42:25.602532 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:25.603069 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:25.610124 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:25.610602 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:25.611047 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:25.611746 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:25.612194 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:25.612620 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:25.627104 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] HTTP exception thrown: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Request method failure captured: Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c HTTP/1.1 Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kY69HgsnGk-xukkbljDftBBm2RmzhmYEtaUSgEi-maUHfPl2BJgC9fq2PKz5KGEk9GrNMgQMKQoGfHZRnHGPJmK9WMHO1c0dgGZ8RS5W0PgCewdKoQkgoSfCYTWT8tSQ7a4pT2A5j1Fd0G93jSNin3eijjRUWmn7RlpGnNCP58i9fk Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:42:25.628678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f10ad025e8e405e82f06156adef690e", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 62968629eb0e4ccf8713787d6c4aef5b Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.631444 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '1219d54a-bde0-49d0-baba-4d67aa8f8d0c'} Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:42:25.632866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.635606 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.638613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Returning 404 to user: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:42:25.638613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-e3d967f1-e438-448b-9da7-725c608acdbb tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 404 len: 111 microversion: 2.20 time: 0.031535 Aug 09 11:42:25.638613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 579/1161] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 9 11:42:25 2022] DELETE /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:42:25.642691 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:25.643959 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: 1219d54a-bde0-49d0-baba-4d67aa8f8d0c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:25.654771 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:25.655282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:25.655718 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:25.656418 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:25.656874 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:25.657299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:25.670542 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] HTTP exception thrown: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Request method failure captured: Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c HTTP/1.1 Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kY69HgsnGk-xukkbljDftBBm2RmzhmYEtaUSgEi-maUHfPl2BJgC9fq2PKz5KGEk9GrNMgQMKQoGfHZRnHGPJmK9WMHO1c0dgGZ8RS5W0PgCewdKoQkgoSfCYTWT8tSQ7a4pT2A5j1Fd0G93jSNin3eijjRUWmn7RlpGnNCP58i9fk Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:42:25.672217 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f10ad025e8e405e82f06156adef690e", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 62968629eb0e4ccf8713787d6c4aef5b Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.673978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': '1219d54a-bde0-49d0-baba-4d67aa8f8d0c'} Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:42:25.674861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. Aug 09 11:42:25.676193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:25.677434 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Returning 404 to user: Instance 1219d54a-bde0-49d0-baba-4d67aa8f8d0c could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:42:25.677434 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5b33ffca-3515-4486-b7fa-ce2d270c61ac tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c" status: 404 len: 111 microversion: 2.20 time: 0.038212 Aug 09 11:42:25.677434 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 583/1162] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:42:25 2022] GET /compute/v2.1/servers/1219d54a-bde0-49d0-baba-4d67aa8f8d0c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:42:26.814454 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:26.815027 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:26.821835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:26.822313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:26.822744 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:26.823459 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:26.823915 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:26.824334 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:26.838485 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] HTTP exception thrown: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Request method failure captured: Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: DELETE /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d HTTP/1.1 Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kY69HgsnGk-xukkbljDftBBm2RmzhmYEtaUSgEi-maUHfPl2BJgC9fq2PKz5KGEk9GrNMgQMKQoGfHZRnHGPJmK9WMHO1c0dgGZ8RS5W0PgCewdKoQkgoSfCYTWT8tSQ7a4pT2A5j1Fd0G93jSNin3eijjRUWmn7RlpGnNCP58i9fk Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:42:26.840120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f10ad025e8e405e82f06156adef690e", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 62968629eb0e4ccf8713787d6c4aef5b Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.841853 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'dec43b88-6ed9-493d-8ac7-c9b9833dad9d'} Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:42:26.842843 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.844312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.845906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Returning 404 to user: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:42:26.845906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-7300fe20-282f-482f-a3d5-194c0973b9a8 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 404 len: 111 microversion: 2.20 time: 0.031012 Aug 09 11:42:26.845906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 580/1163] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 9 11:42:26 2022] DELETE /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 11:42:26.850456 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:42:26.851170 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] [instance: dec43b88-6ed9-493d-8ac7-c9b9833dad9d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:42:26.857973 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:26.858448 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:26.858883 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:26.859598 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:42:26.860054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:42:26.860472 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:42:26.873765 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] HTTP exception thrown: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Request method failure captured: Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d HTTP/1.1 Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kY69HgsnGk-xukkbljDftBBm2RmzhmYEtaUSgEi-maUHfPl2BJgC9fq2PKz5KGEk9GrNMgQMKQoGfHZRnHGPJmK9WMHO1c0dgGZ8RS5W0PgCewdKoQkgoSfCYTWT8tSQ7a4pT2A5j1Fd0G93jSNin3eijjRUWmn7RlpGnNCP58i9fk Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:42:26.875316 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f10ad025e8e405e82f06156adef690e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f10ad025e8e405e82f06156adef690e", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 4f10ad025e8e405e82f06156adef690e Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004339164 Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 62968629eb0e4ccf8713787d6c4aef5b Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004339164-project Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.877042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': 'dec43b88-6ed9-493d-8ac7-c9b9833dad9d'} Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:42:26.877881 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. Aug 09 11:42:26.879237 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:42:26.880385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] Returning 404 to user: Instance dec43b88-6ed9-493d-8ac7-c9b9833dad9d could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:42:26.880385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-64a931c7-014a-4497-9a0d-24d0edbe8d31 tempest-AttachVolumeShelveTestJSON-1004339164 tempest-AttachVolumeShelveTestJSON-1004339164-project] 10.222.0.59 "GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d" status: 404 len: 111 microversion: 2.20 time: 0.030224 Aug 09 11:42:26.880385 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 584/1164] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 11:42:26 2022] GET /compute/v2.1/servers/dec43b88-6ed9-493d-8ac7-c9b9833dad9d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 11:42:42.277276 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:42:42.277913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:42:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:43:54.009658 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=12 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:54.010401 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=24 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:54.207742 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-906c2b15-477f-4988-ad91-2c2a1c6fbdf2 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Action: 'create', calling method: .version_select at 0x7fece283e9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-575759671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOwQNNVmAtlihWDdb6r5N7LEAq5E3jHQ8htvIBmxkJW+5hjEdJKOFg4Dn14mrxaPr6y3AfizfG7y2sfryvVW1wJXxFnsneCU0sSIT08CodGJf+hMNJ55Gx2Dv7mdJfSLA=="}} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:43:54.225362 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-906c2b15-477f-4988-ad91-2c2a1c6fbdf2 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Getting quotas for project ef4b4745a37c42c7b0d60bd9c5f8c8fd. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:43:54.229640 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.quota [None req-906c2b15-477f-4988-ad91-2c2a1c6fbdf2 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Getting quotas for user 2e88ebde3f9b4f1fb4269e71152e99f7 and project ef4b4745a37c42c7b0d60bd9c5f8c8fd. Resources: {'key_pairs'} {{(pid=117792) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:43:54.243902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR oslo.messaging._drivers.impl_rabbit [None req-906c2b15-477f-4988-ad91-2c2a1c6fbdf2 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [139a8e1a-3a5e-48de-9ce3-ec7b51dbc826] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 11:43:55.252736 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [None req-906c2b15-477f-4988-ad91-2c2a1c6fbdf2 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [139a8e1a-3a5e-48de-9ce3-ec7b51dbc826] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 52508. Aug 09 11:43:55.276345 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-906c2b15-477f-4988-ad91-2c2a1c6fbdf2 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.268685 Aug 09 11:43:55.276993 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 581/1165] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 11:43:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:44:15.981900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:15.982633 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:15.986655 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-352631774", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-575759671", "security_groups": [{"name": "tempest-secgroup-smoke-511700421"}], "block_device_mapping_v2": [{"uuid": "060317d5-d8b3-42a6-b754-577f3f973b73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ed2cfa03-a772-4663-a70d-5dcf1c339cc3"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:44:16.113366 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] validate_networks() for [('ed2cfa03-a772-4663-a70d-5dcf1c339cc3', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:44:16.662129 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:44:16.662547 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:44:16.663056 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:44:16.663462 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:44:16.663869 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:44:16.676305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:16.676794 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:16.677244 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:16.678079 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:16.678543 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:16.679003 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:16.700859 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Getting quotas for project ef4b4745a37c42c7b0d60bd9c5f8c8fd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:44:16.705308 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Getting quotas for user 2e88ebde3f9b4f1fb4269e71152e99f7 and project ef4b4745a37c42c7b0d60bd9c5f8c8fd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:44:16.765025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:44:16.767197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='060317d5-d8b3-42a6-b754-577f3f973b73',volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:44:16.920108 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1cd6dd30-63e0-4c1e-b2be-3285117d197c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.939910 Aug 09 11:44:16.920663 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 585/1166] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:44:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:44:16.929304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:16.929942 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:16.933834 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c521257c-4a85-443c-a592-3078a106dd2c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:16.934438 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c521257c-4a85-443c-a592-3078a106dd2c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:16.990039 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c521257c-4a85-443c-a592-3078a106dd2c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:16.998492 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c521257c-4a85-443c-a592-3078a106dd2c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1093 microversion: 2.1 time: 0.070667 Aug 09 11:44:16.999105 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 582/1167] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:16 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:18.020422 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-90255048-8d3e-4dc4-ba64-936ac559f6f8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:18.021042 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-90255048-8d3e-4dc4-ba64-936ac559f6f8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:18.075214 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-90255048-8d3e-4dc4-ba64-936ac559f6f8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:18.082913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-90255048-8d3e-4dc4-ba64-936ac559f6f8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1093 microversion: 2.1 time: 0.067621 Aug 09 11:44:18.096146 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 586/1168] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:18 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:19.104176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-363bae3e-1222-4eb5-9f7c-ef79f185dd31 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:19.104824 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-363bae3e-1222-4eb5-9f7c-ef79f185dd31 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:19.158565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-363bae3e-1222-4eb5-9f7c-ef79f185dd31 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:19.166586 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-363bae3e-1222-4eb5-9f7c-ef79f185dd31 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1093 microversion: 2.1 time: 0.066310 Aug 09 11:44:19.167188 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 583/1169] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:19 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:20.188697 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-23fac147-f6be-4757-9a0f-ddbcc8ddee95 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:20.189394 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-23fac147-f6be-4757-9a0f-ddbcc8ddee95 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:20.253944 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-23fac147-f6be-4757-9a0f-ddbcc8ddee95 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:20.261131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-23fac147-f6be-4757-9a0f-ddbcc8ddee95 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1093 microversion: 2.1 time: 0.077006 Aug 09 11:44:20.261836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 587/1170] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:20 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:21.285407 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:21.286065 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:21.295200 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:21.295686 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:21.296123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:21.296824 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:21.297275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:21.297697 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:21.366573 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:21.374281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-ac593d2d-c1d0-4c60-a083-4dac6f338c5c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1143 microversion: 2.1 time: 0.095075 Aug 09 11:44:21.374838 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 584/1171] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:21 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1143 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:22.396351 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:22.396963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:22.404305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:22.405061 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:22.405690 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:22.406592 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:22.407287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:22.407683 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:22.474384 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:22.482984 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-18fb18f7-2ba8-4947-87ab-4ce7dc8ecedb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1209 microversion: 2.1 time: 0.090407 Aug 09 11:44:22.483871 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 588/1172] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:22 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:23.015289 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:44:23.015884 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Tue Aug 9 11:44:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:44:23.504020 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:23.504636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:23.511642 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:23.512121 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:23.512554 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:23.513247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:23.513699 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:23.514119 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:23.599635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-c9e5776e-7e6e-492d-94ef-15bcad66cd05 req-03894cc4-755f-4d11-b28e-cceace6a7de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a958af07-bc3f-4975-ad4b-4a90d796e273", "tag": "dcb7997e-14d2-47c2-8ccb-cd7993ccda10"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:44:23.610208 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-c9e5776e-7e6e-492d-94ef-15bcad66cd05 req-03894cc4-755f-4d11-b28e-cceace6a7de4 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:23.610971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-c9e5776e-7e6e-492d-94ef-15bcad66cd05 req-03894cc4-755f-4d11-b28e-cceace6a7de4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:23.611493 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-c9e5776e-7e6e-492d-94ef-15bcad66cd05 req-03894cc4-755f-4d11-b28e-cceace6a7de4 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:23.639165 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-c9e5776e-7e6e-492d-94ef-15bcad66cd05 req-03894cc4-755f-4d11-b28e-cceace6a7de4 service nova] Creating event network-changed:dcb7997e-14d2-47c2-8ccb-cd7993ccda10 for instance a958af07-bc3f-4975-ad4b-4a90d796e273 on hv-cinder-84989 Aug 09 11:44:23.644492 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-c9e5776e-7e6e-492d-94ef-15bcad66cd05 req-03894cc4-755f-4d11-b28e-cceace6a7de4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049810 Aug 09 11:44:23.648332 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:23.652381 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 589/1173] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:44:23.656518 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b9c9a76b-a703-4bb7-9ad7-17ad41a7b8d9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.156606 Aug 09 11:44:23.657031 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 585/1174] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:23 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:24.681050 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:24.681908 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:24.691148 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:24.691780 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:24.692355 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:24.693430 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:24.693888 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:24.694319 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:24.840190 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:24.848381 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c71214d8-c407-4137-aa3f-a7f40805a313 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.173294 Aug 09 11:44:24.848887 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 590/1175] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:24 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:25.872577 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:25.873352 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:25.881917 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:25.882392 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:25.882848 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:25.883530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:25.883976 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:25.884390 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:26.034961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:26.042980 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-30a5b597-8064-440b-8707-064c6c951c4d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.175567 Aug 09 11:44:26.043544 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 586/1176] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:25 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:27.064940 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:27.065583 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:27.068256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:27.074965 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:27.075498 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:27.075991 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:27.076773 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:27.077284 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:27.078111 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:27.219580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:27.227209 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-77314ca7-2d42-4ab8-8efa-1859b3b9be1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.166749 Aug 09 11:44:27.227744 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 591/1177] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:27 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:28.251711 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:28.252425 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:28.259114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:28.259595 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:28.260021 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:28.260706 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:28.261149 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:28.261558 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:28.405033 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:28.412678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9e59bb0a-7566-462e-96c6-02e21a8f01e3 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.166096 Aug 09 11:44:28.413234 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 587/1178] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:28 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:29.433560 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:29.434173 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:29.440955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:29.441442 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:29.441887 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:29.442576 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:29.443072 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:29.443570 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:29.586080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:29.596828 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9ed2406a-dec8-4df0-8870-bf5d6688d714 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.166895 Aug 09 11:44:29.597751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 592/1179] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:29 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:30.619311 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:30.619919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:30.621753 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:30.627906 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:30.628384 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:30.628815 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:30.629515 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:30.629995 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:30.630418 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:30.774770 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:30.787199 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-46a3940e-20ad-41e9-8a83-b4d7fc970166 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.171448 Aug 09 11:44:30.787937 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 588/1180] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:30 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:31.814998 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:31.815756 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:31.817963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=10 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:44:31.823849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:31.824318 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:31.824751 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:31.825450 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:31.825909 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:31.826332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:31.961299 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:31.969257 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d7f51603-a991-4c5b-976f-6611a3a510f9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.159134 Aug 09 11:44:31.969791 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 593/1181] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:31 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:32.991138 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:32.991914 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:32.998609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:32.999107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:32.999558 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:33.000259 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:33.000705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:33.001123 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:33.147476 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:33.155076 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-28547768-e63a-4aee-9272-7a56ee5cf17c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.168629 Aug 09 11:44:33.155656 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 589/1182] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:32 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:34.178356 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:34.179251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:34.188533 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:34.189226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:34.189765 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:34.190788 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:34.191464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:34.192096 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:34.336272 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:34.346102 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-85858a2a-3389-43d9-b4a7-58ad96c68b1f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.172573 Aug 09 11:44:34.346895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 594/1183] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:34 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:34.679667 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-55eb8e98-bc69-460c-96b3-1775cc1b27fd req-694f9676-9619-4b9e-8ef1-b5f0bbe2e546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a958af07-bc3f-4975-ad4b-4a90d796e273", "name": "network-vif-plugged", "status": "completed", "tag": "dcb7997e-14d2-47c2-8ccb-cd7993ccda10"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:44:34.695229 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-55eb8e98-bc69-460c-96b3-1775cc1b27fd req-694f9676-9619-4b9e-8ef1-b5f0bbe2e546 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:34.696104 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-55eb8e98-bc69-460c-96b3-1775cc1b27fd req-694f9676-9619-4b9e-8ef1-b5f0bbe2e546 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:34.696665 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-55eb8e98-bc69-460c-96b3-1775cc1b27fd req-694f9676-9619-4b9e-8ef1-b5f0bbe2e546 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:34.709572 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-55eb8e98-bc69-460c-96b3-1775cc1b27fd req-694f9676-9619-4b9e-8ef1-b5f0bbe2e546 service nova] Creating event network-vif-plugged:dcb7997e-14d2-47c2-8ccb-cd7993ccda10 for instance a958af07-bc3f-4975-ad4b-4a90d796e273 on hv-cinder-84989 Aug 09 11:44:34.713040 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR oslo.messaging._drivers.impl_rabbit [req-55eb8e98-bc69-460c-96b3-1775cc1b27fd req-694f9676-9619-4b9e-8ef1-b5f0bbe2e546 service nova] [1477015f-3a64-4a22-af2a-d92cb68544f2] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 11:44:35.367955 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:35.368559 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:35.375476 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:35.375958 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:35.376390 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:35.377081 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:35.377516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:35.377937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:35.525084 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:35.537383 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f0d84b1e-234f-4710-a40a-21c5dc9f891e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.173116 Aug 09 11:44:35.537993 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 595/1184] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:35 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:35.723616 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [req-55eb8e98-bc69-460c-96b3-1775cc1b27fd req-694f9676-9619-4b9e-8ef1-b5f0bbe2e546 service nova] [1477015f-3a64-4a22-af2a-d92cb68544f2] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 52716. Aug 09 11:44:35.728102 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-55eb8e98-bc69-460c-96b3-1775cc1b27fd req-694f9676-9619-4b9e-8ef1-b5f0bbe2e546 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.148984 Aug 09 11:44:35.728703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 590/1185] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:44:36.560015 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:36.560628 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:36.569007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:36.569510 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:36.569936 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:36.570613 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:36.571097 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:36.571515 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:36.724419 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:36.735755 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-69fab3c3-3b40-4693-adde-96252802edea tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1264 microversion: 2.1 time: 0.181282 Aug 09 11:44:36.736693 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 596/1186] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:36 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:37.759144 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:37.759717 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:37.766377 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:37.766901 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:37.767330 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:37.768020 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:37.768473 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:37.768916 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:37.910626 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:37.918456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1d57e8c3-7b9b-40ec-bd94-da3e51769144 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1451 microversion: 2.1 time: 0.164229 Aug 09 11:44:37.919051 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 591/1187] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:37 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:37.938382 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:44:37.939021 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:44:37.946029 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:37.946521 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:37.946994 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:37.947704 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:37.948159 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:37.948585 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:38.092968 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:44:38.103061 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-76633776-08c5-4bd1-bfc3-f4f34b4ed880 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1451 microversion: 2.1 time: 0.168530 Aug 09 11:44:38.103624 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 597/1188] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:44:37 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:44:39.901682 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-4acf60f6-1789-421b-b0ae-ce9780b21c41 req-5d101f68-a696-44cd-91ba-f09c85bf36b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a958af07-bc3f-4975-ad4b-4a90d796e273", "tag": "dcb7997e-14d2-47c2-8ccb-cd7993ccda10"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:44:39.911345 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4acf60f6-1789-421b-b0ae-ce9780b21c41 req-5d101f68-a696-44cd-91ba-f09c85bf36b0 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:44:39.911945 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4acf60f6-1789-421b-b0ae-ce9780b21c41 req-5d101f68-a696-44cd-91ba-f09c85bf36b0 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:44:39.912463 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-4acf60f6-1789-421b-b0ae-ce9780b21c41 req-5d101f68-a696-44cd-91ba-f09c85bf36b0 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:44:39.923547 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-4acf60f6-1789-421b-b0ae-ce9780b21c41 req-5d101f68-a696-44cd-91ba-f09c85bf36b0 service nova] Creating event network-changed:dcb7997e-14d2-47c2-8ccb-cd7993ccda10 for instance a958af07-bc3f-4975-ad4b-4a90d796e273 on hv-cinder-84989 Aug 09 11:44:39.928761 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-4acf60f6-1789-421b-b0ae-ce9780b21c41 req-5d101f68-a696-44cd-91ba-f09c85bf36b0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087529 Aug 09 11:44:39.929286 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 592/1189] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:45:23.979915 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:45:23.980863 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:45:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:46:24.815708 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:46:24.816849 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:46:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:46:54.790541 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:46:54.791648 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=58 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:46:54.798633 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:46:54.799489 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:46:54.808709 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:54.809187 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:54.809620 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:54.810304 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:54.810758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:54.811215 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:54.838016 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:46:54.925614 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-37fc637c-b477-4626-aadd-34c47dd52db1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 204 len: 0 microversion: 2.1 time: 0.138328 Aug 09 11:46:54.926191 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 598/1190] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:46:54 2022] DELETE /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:46:54.933097 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd57bbce-b6f7-42e3-9cc5-48162058b767] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 11:46:54.933691 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=26 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:46:54.934388 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=46 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:46:54.938667 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:46:54.939386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:46:54.946212 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:54.946688 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:54.947175 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:54.947897 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:54.948342 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:54.948758 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:55.405159 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:46:55.413303 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-876c770c-40b8-4ed6-bb78-c234ee63ce2d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1575 microversion: 2.1 time: 0.482136 Aug 09 11:46:55.413877 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 593/1191] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:46:54 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1575 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:46:56.435596 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:46:56.436321 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:46:56.442910 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:56.443391 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:56.443824 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:56.444496 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:56.444937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:56.445360 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:56.631861 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:46:56.640562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f99a58d1-7dd4-438e-9465-994e80b1d303 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1575 microversion: 2.1 time: 0.209286 Aug 09 11:46:56.641131 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 599/1192] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:46:56 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:46:57.617998 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-58d0726c-34b4-41eb-aadc-496d1d23f24f req-dc6b72d1-f14e-4e9a-a1a2-96853d623304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a958af07-bc3f-4975-ad4b-4a90d796e273", "name": "network-vif-deleted", "tag": "dcb7997e-14d2-47c2-8ccb-cd7993ccda10"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:46:57.629487 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-58d0726c-34b4-41eb-aadc-496d1d23f24f req-dc6b72d1-f14e-4e9a-a1a2-96853d623304 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:57.630133 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-58d0726c-34b4-41eb-aadc-496d1d23f24f req-dc6b72d1-f14e-4e9a-a1a2-96853d623304 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:57.630564 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-58d0726c-34b4-41eb-aadc-496d1d23f24f req-dc6b72d1-f14e-4e9a-a1a2-96853d623304 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:57.643679 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-58d0726c-34b4-41eb-aadc-496d1d23f24f req-dc6b72d1-f14e-4e9a-a1a2-96853d623304 service nova] Creating event network-vif-deleted:dcb7997e-14d2-47c2-8ccb-cd7993ccda10 for instance a958af07-bc3f-4975-ad4b-4a90d796e273 on hv-cinder-84989 Aug 09 11:46:57.647288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd57bbce-b6f7-42e3-9cc5-48162058b767] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 52782. Aug 09 11:46:57.649006 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-58d0726c-34b4-41eb-aadc-496d1d23f24f req-dc6b72d1-f14e-4e9a-a1a2-96853d623304 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034873 Aug 09 11:46:57.650045 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 594/1193] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:46:57.661574 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:46:57.665374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:46:57.674805 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:57.675342 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:57.675779 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:57.676494 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:57.676951 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:57.677374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:57.749301 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:46:57.757306 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4159fb0c-3580-4b5e-8947-127a1eee0386 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 200 len: 1224 microversion: 2.1 time: 0.099576 Aug 09 11:46:57.757927 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 600/1194] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:46:57 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:46:58.779063 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:46:58.779828 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:46:58.789745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:58.790415 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:58.790976 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:58.791982 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:58.792549 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:58.793075 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:58.810301 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] HTTP exception thrown: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Request method failure captured: Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 HTTP/1.1 Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kh0t_0eA2DUHHjhx_FHwagKPPV033R1ze_4FZLCs4996MpB4mVqKiotLTwJU12WlnJKRpAfMuxC65FGNS21g2OxLVPx5O8AIFvGfun0WvxTSB_XZIhxbWQ1S77ZzEsrK0zIONqcYDKcIFy5EO6egHffBOdQ6_EVEiqeuyfT44p9Kok Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:46:58.811894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ef4b4745a37c42c7b0d60bd9c5f8c8fd", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestVolumeBootPattern-338320703 Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 2e88ebde3f9b4f1fb4269e71152e99f7 Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:46:58.813777 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'a958af07-bc3f-4975-ad4b-4a90d796e273'} Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:46:58.814739 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:46:58.816296 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:46:58.817807 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Returning 404 to user: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:46:58.817807 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-72c29bbf-d2d4-4eaf-801d-8b78ba996cd7 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 404 len: 111 microversion: 2.1 time: 0.039259 Aug 09 11:46:58.817807 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 595/1195] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:46:58 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:46:58.864478 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1250597360", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-575759671", "security_groups": [{"name": "tempest-secgroup-smoke-511700421"}], "block_device_mapping_v2": [{"uuid": "060317d5-d8b3-42a6-b754-577f3f973b73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ed2cfa03-a772-4663-a70d-5dcf1c339cc3"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:46:58.978459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] validate_networks() for [('ed2cfa03-a772-4663-a70d-5dcf1c339cc3', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:46:59.348358 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:46:59.348783 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:46:59.349259 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:46:59.349666 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:46:59.350082 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:46:59.360018 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:59.360503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:59.360942 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:59.361674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:46:59.362134 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:46:59.362562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:46:59.379947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Getting quotas for project ef4b4745a37c42c7b0d60bd9c5f8c8fd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:46:59.384241 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Getting quotas for user 2e88ebde3f9b4f1fb4269e71152e99f7 and project ef4b4745a37c42c7b0d60bd9c5f8c8fd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:46:59.441674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:46:59.443870 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='060317d5-d8b3-42a6-b754-577f3f973b73',volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:46:59.598284 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bd684860-82f0-4679-b1b1-b61899db0b01 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737435 Aug 09 11:46:59.598972 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 601/1196] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:46:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:46:59.610599 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a236f1e1-4ebc-4a83-8794-5fdca217dde8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:46:59.611332 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a236f1e1-4ebc-4a83-8794-5fdca217dde8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:46:59.664426 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a236f1e1-4ebc-4a83-8794-5fdca217dde8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:46:59.671303 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a236f1e1-4ebc-4a83-8794-5fdca217dde8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1094 microversion: 2.1 time: 0.064653 Aug 09 11:46:59.671863 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 596/1197] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:46:59 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:00.691856 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:00.693234 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:00.700629 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:00.701110 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:00.701534 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:00.702223 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:00.702833 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:00.703703 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:00.768008 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:00.777394 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ef6c1ea5-2b1d-4339-a468-c3845b793d85 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1200 microversion: 2.1 time: 0.090153 Aug 09 11:47:00.778482 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 602/1198] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:00 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:01.798009 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:01.798972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:01.806316 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:01.806796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:01.807254 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:01.807949 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:01.808430 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:01.808848 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:01.944102 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:01.952613 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-c88e74a6-f478-49a1-a243-a4c4af5af191 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.158701 Aug 09 11:47:01.953275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 597/1199] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:01 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:02.027045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-bc8bfeb2-9fc1-4e83-a313-7d2fcdd41677 req-4f8262a4-8008-4a7e-9829-96438664960d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f04c4be-4924-44cd-a3ac-72284638563c", "tag": "dd723cd1-6c21-47f3-be40-f48a3b95baec"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:47:02.037347 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-bc8bfeb2-9fc1-4e83-a313-7d2fcdd41677 req-4f8262a4-8008-4a7e-9829-96438664960d service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:02.037969 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-bc8bfeb2-9fc1-4e83-a313-7d2fcdd41677 req-4f8262a4-8008-4a7e-9829-96438664960d service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:02.038409 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-bc8bfeb2-9fc1-4e83-a313-7d2fcdd41677 req-4f8262a4-8008-4a7e-9829-96438664960d service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:02.049920 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-bc8bfeb2-9fc1-4e83-a313-7d2fcdd41677 req-4f8262a4-8008-4a7e-9829-96438664960d service nova] Creating event network-changed:dd723cd1-6c21-47f3-be40-f48a3b95baec for instance 5f04c4be-4924-44cd-a3ac-72284638563c on hv-cinder-84989 Aug 09 11:47:02.054922 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-bc8bfeb2-9fc1-4e83-a313-7d2fcdd41677 req-4f8262a4-8008-4a7e-9829-96438664960d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031969 Aug 09 11:47:02.055512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 603/1200] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:47:02.975830 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:02.976712 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:02.983530 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:02.984028 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:02.984462 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:02.985155 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:02.985603 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:02.986025 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:03.117185 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:03.124838 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-75bdb32d-b4b3-433e-8679-a21d35de6a1d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.154446 Aug 09 11:47:03.125406 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 598/1201] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:02 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:04.151393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:04.152537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:04.163127 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:04.163921 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:04.164519 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:04.165220 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:04.165674 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:04.166105 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:04.309752 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:04.317947 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f8d00026-9ad5-4518-aca5-be01ff629543 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.174708 Aug 09 11:47:04.318520 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 604/1202] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:04 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:05.343862 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:05.344894 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:05.356153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:05.356952 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:05.357672 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:05.358796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:05.359618 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:05.360327 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:05.493787 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:05.501725 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2ca354c1-fbc9-4b53-8c49-61071aadf387 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.164423 Aug 09 11:47:05.502293 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 599/1203] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:05 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:06.525402 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:06.526251 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:06.536635 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:06.537305 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:06.537892 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:06.538888 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:06.539461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:06.539899 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:06.687463 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:06.698310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c747ce2d-3db6-411e-b0c2-80a55ba4d3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.179117 Aug 09 11:47:06.698902 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 605/1204] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:06 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:47:07.722783 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:07.723796 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:07.734636 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:07.735483 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:07.736202 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:07.737344 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:07.738091 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:07.738802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:07.874597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:07.882835 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-49886643-ad1b-4fea-b01d-8f6824d247a9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.166629 Aug 09 11:47:07.883446 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 600/1205] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:07 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:08.907808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:08.908785 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:08.918254 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:08.918739 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:08.919214 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:08.919918 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:08.920376 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:08.920808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:09.056981 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:09.064606 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-65edd104-88ef-4e99-825a-152eb3c8d03e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.163377 Aug 09 11:47:09.065172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 606/1206] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:08 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:10.091368 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:10.092376 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:10.096113 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=2 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:47:10.104403 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:10.104885 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:10.105319 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:10.106013 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:10.106465 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:10.106901 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:10.255340 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:10.263317 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-6cf97260-430a-4cb7-a5ef-20647bf000ce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.178472 Aug 09 11:47:10.263863 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 601/1207] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:10 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:11.284290 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:11.284913 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:11.286937 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:47:11.287602 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:47:11.293082 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:11.293567 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:11.293999 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:11.294699 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:11.295177 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:11.295595 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:11.438992 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:11.448007 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-05db5fd6-c6cf-4774-bde6-1862aebdb60e tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.167267 Aug 09 11:47:11.448776 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 607/1208] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:11 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:12.473877 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:12.475240 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:12.483200 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:12.483690 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:12.484124 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:12.484830 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:12.485281 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:12.485703 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:12.621100 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:12.628693 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-fdad9ffa-3565-476a-ba9a-5aacaad5c4ac tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.161604 Aug 09 11:47:12.629237 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 602/1209] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:12 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:13.280808 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-45310c8c-aa7d-4f21-a17c-262a0c52ba47 req-57bd22f8-fbcd-4cf2-a700-aa7b1174de9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f04c4be-4924-44cd-a3ac-72284638563c", "name": "network-vif-plugged", "status": "completed", "tag": "dd723cd1-6c21-47f3-be40-f48a3b95baec"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:47:13.292500 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-45310c8c-aa7d-4f21-a17c-262a0c52ba47 req-57bd22f8-fbcd-4cf2-a700-aa7b1174de9a service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:13.292971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-45310c8c-aa7d-4f21-a17c-262a0c52ba47 req-57bd22f8-fbcd-4cf2-a700-aa7b1174de9a service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:13.293400 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-45310c8c-aa7d-4f21-a17c-262a0c52ba47 req-57bd22f8-fbcd-4cf2-a700-aa7b1174de9a service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:13.304574 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-45310c8c-aa7d-4f21-a17c-262a0c52ba47 req-57bd22f8-fbcd-4cf2-a700-aa7b1174de9a service nova] Creating event network-vif-plugged:dd723cd1-6c21-47f3-be40-f48a3b95baec for instance 5f04c4be-4924-44cd-a3ac-72284638563c on hv-cinder-84989 Aug 09 11:47:13.309626 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-45310c8c-aa7d-4f21-a17c-262a0c52ba47 req-57bd22f8-fbcd-4cf2-a700-aa7b1174de9a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 Aug 09 11:47:13.310221 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 608/1210] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:47:13.649647 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:13.650404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:13.657533 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:13.657947 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:13.658381 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:13.659386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:13.660002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:13.660422 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:13.805639 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:13.813666 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-512fd358-eea4-4459-8391-ea03a3b85bf9 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.167995 Aug 09 11:47:13.814238 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 603/1211] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:13 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:14.840848 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:14.841830 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:14.852332 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:14.853201 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:14.853639 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:14.854335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:14.854790 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:14.855246 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:14.993668 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:15.001496 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7e9d9268-db0e-4f35-b5e1-4ed069144e14 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1265 microversion: 2.1 time: 0.168748 Aug 09 11:47:15.002064 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 609/1212] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:14 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:16.024831 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:16.025786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:16.034710 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:16.035389 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:16.035972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:16.036892 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:16.037496 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:16.038062 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:16.177554 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:16.189182 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-881e6b2a-cf32-4835-8d99-e68e8986ff87 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1452 microversion: 2.1 time: 0.169344 Aug 09 11:47:16.189981 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 604/1213] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:16 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:16.212068 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:47:16.212711 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:47:16.219497 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:16.219968 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:16.220398 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:16.221090 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:16.221544 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:16.221965 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:16.362900 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:47:16.374336 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bf4c9e9f-dbd7-4ba7-9eae-5da7990c5128 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1452 microversion: 2.1 time: 0.165939 Aug 09 11:47:16.375160 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 610/1214] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:47:16 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:47:17.993289 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-bdf6c5ff-a4ac-43cb-9ab7-308325cd4ebb req-2b8e763d-2818-423b-9511-b4acfb81fd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f04c4be-4924-44cd-a3ac-72284638563c", "tag": "dd723cd1-6c21-47f3-be40-f48a3b95baec"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:47:18.003405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-bdf6c5ff-a4ac-43cb-9ab7-308325cd4ebb req-2b8e763d-2818-423b-9511-b4acfb81fd29 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:47:18.003863 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-bdf6c5ff-a4ac-43cb-9ab7-308325cd4ebb req-2b8e763d-2818-423b-9511-b4acfb81fd29 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:47:18.004287 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-bdf6c5ff-a4ac-43cb-9ab7-308325cd4ebb req-2b8e763d-2818-423b-9511-b4acfb81fd29 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:47:18.015243 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-bdf6c5ff-a4ac-43cb-9ab7-308325cd4ebb req-2b8e763d-2818-423b-9511-b4acfb81fd29 service nova] Creating event network-changed:dd723cd1-6c21-47f3-be40-f48a3b95baec for instance 5f04c4be-4924-44cd-a3ac-72284638563c on hv-cinder-84989 Aug 09 11:47:18.020378 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-bdf6c5ff-a4ac-43cb-9ab7-308325cd4ebb req-2b8e763d-2818-423b-9511-b4acfb81fd29 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030785 Aug 09 11:47:18.020998 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 605/1215] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:47:43.024841 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:47:43.025952 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Tue Aug 9 11:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:48:43.991150 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:48:43.992102 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:48:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:49:19.053660 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac0c90b4-564e-43ab-941d-e7b60667dff5] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 11:49:19.054282 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:19.054997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:19.059334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1509360665", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-575759671", "security_groups": [{"name": "tempest-secgroup-smoke-511700421"}], "block_device_mapping_v2": [{"uuid": "f554baf1-3ff5-4734-a841-0f269e41b1b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ed2cfa03-a772-4663-a70d-5dcf1c339cc3"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:49:19.175093 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] validate_networks() for [('ed2cfa03-a772-4663-a70d-5dcf1c339cc3', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 11:49:19.582647 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 11:49:19.583266 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 11:49:19.583977 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 11:49:19.584485 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 11:49:19.585068 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 11:49:19.596967 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:19.597441 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:19.597893 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:19.598614 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:19.599089 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:19.599495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:19.616095 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Getting quotas for project ef4b4745a37c42c7b0d60bd9c5f8c8fd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 11:49:19.620246 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Getting quotas for user 2e88ebde3f9b4f1fb4269e71152e99f7 and project ef4b4745a37c42c7b0d60bd9c5f8c8fd. Resources: {'ram', 'instances', 'cores'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 11:49:19.686241 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 11:49:19.688488 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f554baf1-3ff5-4734-a841-0f269e41b1b3',volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 11:49:19.823431 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-dd20e281-00d2-4fe9-a25d-6d9a5652cd76 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.771784 Aug 09 11:49:19.824086 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 611/1216] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 11:49:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 11:49:19.833332 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd57bbce-b6f7-42e3-9cc5-48162058b767] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 09 11:49:19.833973 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=28 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:19.834696 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=60 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:19.839278 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2f1564b8-3b36-4bbc-ab4b-a379b3e30e6a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:19.839649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2f1564b8-3b36-4bbc-ab4b-a379b3e30e6a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:19.897923 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2f1564b8-3b36-4bbc-ab4b-a379b3e30e6a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:19.908288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2f1564b8-3b36-4bbc-ab4b-a379b3e30e6a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1094 microversion: 2.1 time: 0.076763 Aug 09 11:49:19.909173 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 606/1217] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:19 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:20.212075 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:49:20.212437 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Tue Aug 9 11:49:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:49:20.930060 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2bfdac19-257e-42fb-b5ef-a9f214bdb676 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:20.930673 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2bfdac19-257e-42fb-b5ef-a9f214bdb676 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:20.940971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac0c90b4-564e-43ab-941d-e7b60667dff5] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 52958. Aug 09 11:49:20.986917 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2bfdac19-257e-42fb-b5ef-a9f214bdb676 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:20.994125 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2bfdac19-257e-42fb-b5ef-a9f214bdb676 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1094 microversion: 2.1 time: 0.069013 Aug 09 11:49:20.994685 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 612/1218] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:20 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:22.014943 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4608d710-361a-455e-90ff-040663c10681 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:22.015579 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4608d710-361a-455e-90ff-040663c10681 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:22.041722 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd57bbce-b6f7-42e3-9cc5-48162058b767] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 52964. Aug 09 11:49:22.072902 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4608d710-361a-455e-90ff-040663c10681 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:22.079836 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4608d710-361a-455e-90ff-040663c10681 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1094 microversion: 2.1 time: 0.068942 Aug 09 11:49:22.080387 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 607/1219] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:22 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:23.104289 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8b3952f4-60a8-4086-a284-0c1a6bd5db06 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:23.105262 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8b3952f4-60a8-4086-a284-0c1a6bd5db06 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:23.163806 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8b3952f4-60a8-4086-a284-0c1a6bd5db06 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:23.170788 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8b3952f4-60a8-4086-a284-0c1a6bd5db06 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1094 microversion: 2.1 time: 0.072988 Aug 09 11:49:23.171393 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 613/1220] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:23 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:24.195561 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:24.196286 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:24.205424 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:24.206023 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:24.206559 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:24.207455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:24.208015 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:24.208539 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:24.284506 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:24.292472 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-3dfb9a2e-dc34-4780-ab75-e4262a37dcb0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1144 microversion: 2.1 time: 0.102147 Aug 09 11:49:24.293282 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 608/1221] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:24 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1144 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:25.313507 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:25.314124 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:25.320978 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:25.321464 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:25.322226 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:25.322985 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:25.323445 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:25.323857 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:25.384484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:25.392328 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-10c2ddec-909f-45c1-8e60-b3777fd99a9f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1210 microversion: 2.1 time: 0.082861 Aug 09 11:49:25.393225 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 614/1222] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:25 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:26.405540 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-cd0ca4f5-c279-42e8-8862-4dc65978e57e req-67eead4f-9c2b-4e59-9c21-76a397328880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "235d907b-d003-4459-958f-83f6c65ed8ef", "tag": "de0c1f5c-0633-4f36-8a23-fd8cda391e8e"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:49:26.413292 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:26.413971 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:26.421000 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:26.421334 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:26.421835 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:26.422828 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:26.423298 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:26.423784 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:26.424934 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-cd0ca4f5-c279-42e8-8862-4dc65978e57e req-67eead4f-9c2b-4e59-9c21-76a397328880 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:26.425678 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-cd0ca4f5-c279-42e8-8862-4dc65978e57e req-67eead4f-9c2b-4e59-9c21-76a397328880 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:26.426176 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-cd0ca4f5-c279-42e8-8862-4dc65978e57e req-67eead4f-9c2b-4e59-9c21-76a397328880 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:26.439458 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-cd0ca4f5-c279-42e8-8862-4dc65978e57e req-67eead4f-9c2b-4e59-9c21-76a397328880 service nova] Creating event network-changed:de0c1f5c-0633-4f36-8a23-fd8cda391e8e for instance 235d907b-d003-4459-958f-83f6c65ed8ef on hv-cinder-84989 Aug 09 11:49:26.445712 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-cd0ca4f5-c279-42e8-8862-4dc65978e57e req-67eead4f-9c2b-4e59-9c21-76a397328880 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102466 Aug 09 11:49:26.447313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 609/1223] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:49:26.560743 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:26.569197 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-530d6661-1d4c-499e-96e2-f960600bc82d tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.159851 Aug 09 11:49:26.570117 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 615/1224] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:26 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:49:27.596785 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:27.597999 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:27.608312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:27.609090 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:27.609802 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:27.610977 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:27.611714 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:27.612402 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:27.763959 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:27.772136 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-26e462bc-daeb-4124-871b-c02f2602e638 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.183139 Aug 09 11:49:27.772713 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 610/1225] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:27 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:28.793157 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:28.793749 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:28.800622 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:28.801135 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:28.801568 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:28.802254 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:28.802707 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:28.803231 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:28.940036 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:28.948486 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4049ee33-e52a-4813-8921-cea3015c8749 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.159332 Aug 09 11:49:28.949052 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 616/1226] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:28 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:29.973624 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:29.974890 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:29.986114 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:29.986852 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:29.987643 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:29.988573 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:29.989027 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:29.989450 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:30.124624 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:30.132651 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2776c70b-bf1c-40b2-ba95-d3c2f0141838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.165432 Aug 09 11:49:30.133214 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 611/1227] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:29 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:31.157459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:31.158503 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:31.161004 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:31.167667 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:31.168099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:31.168554 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:31.169313 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:31.169788 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:31.170230 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:31.307172 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:31.319344 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-372abd02-149b-4778-be52-fd30758a7689 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.168080 Aug 09 11:49:31.320193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 617/1228] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:31 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:32.344972 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:32.345830 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:32.349075 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell0:SELECT=4 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:32.354745 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:32.355275 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:32.355708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:32.356398 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:32.356878 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:32.357267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:32.496546 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:32.504412 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-4505ed65-95d2-4edf-bcae-0c5c23d2fc5f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.166076 Aug 09 11:49:32.505037 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 612/1229] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:32 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:33.525747 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:33.526293 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:33.529362 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=10 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:49:33.535725 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:33.536213 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:33.536746 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:33.537834 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:33.538556 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:33.539001 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:33.675341 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:33.683248 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-09c4fca1-ba1e-4c3b-8b82-a2f3d207345b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.162488 Aug 09 11:49:33.683815 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 618/1230] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:33 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:34.715538 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:34.716354 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:34.725788 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:34.726272 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:34.726705 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:34.727434 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:34.727889 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:34.728313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:34.870747 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:34.878704 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-de50f2a9-d9bf-4991-b5b6-f594adc4c838 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.169892 Aug 09 11:49:34.879427 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 613/1231] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:34 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:35.900253 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:35.900873 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:35.907692 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:35.908179 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:35.908613 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:35.909310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:35.909773 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:35.910202 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:36.046138 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:36.053795 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-894b1707-6e56-4dee-a356-b79ae260d49a tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.157434 Aug 09 11:49:36.054404 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 619/1232] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:35 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:37.079248 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:37.080253 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:37.091299 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:37.092095 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:37.092816 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:37.093956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:37.094708 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:37.095468 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:37.233171 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:37.240953 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-f917b351-7362-4a06-83a2-39bfc393191c tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.168255 Aug 09 11:49:37.241547 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 614/1233] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:37 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:38.154537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-510073a5-a01c-4da7-b44e-c5511cb873f6 req-8e3b3173-2697-4b91-a5f2-591d31d4b380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235d907b-d003-4459-958f-83f6c65ed8ef", "name": "network-vif-plugged", "status": "completed", "tag": "de0c1f5c-0633-4f36-8a23-fd8cda391e8e"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:49:38.164433 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-510073a5-a01c-4da7-b44e-c5511cb873f6 req-8e3b3173-2697-4b91-a5f2-591d31d4b380 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:38.164911 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-510073a5-a01c-4da7-b44e-c5511cb873f6 req-8e3b3173-2697-4b91-a5f2-591d31d4b380 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:38.165340 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-510073a5-a01c-4da7-b44e-c5511cb873f6 req-8e3b3173-2697-4b91-a5f2-591d31d4b380 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:38.177066 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-510073a5-a01c-4da7-b44e-c5511cb873f6 req-8e3b3173-2697-4b91-a5f2-591d31d4b380 service nova] Creating event network-vif-plugged:de0c1f5c-0633-4f36-8a23-fd8cda391e8e for instance 235d907b-d003-4459-958f-83f6c65ed8ef on hv-cinder-84989 Aug 09 11:49:38.180774 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR oslo.messaging._drivers.impl_rabbit [req-510073a5-a01c-4da7-b44e-c5511cb873f6 req-8e3b3173-2697-4b91-a5f2-591d31d4b380 service nova] [25b88cf9-4341-414d-8131-96a1a8f2f24c] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 11:49:38.263786 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:38.264758 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:38.274195 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:38.274874 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:38.275600 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:38.276541 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:38.277174 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:38.277758 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:38.411517 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:38.419136 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-2658101b-dbb3-4ab9-8a4a-5944e0033311 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.160686 Aug 09 11:49:38.419669 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 615/1234] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:38 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:39.192193 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [req-510073a5-a01c-4da7-b44e-c5511cb873f6 req-8e3b3173-2697-4b91-a5f2-591d31d4b380 service nova] [25b88cf9-4341-414d-8131-96a1a8f2f24c] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 53020. Aug 09 11:49:39.196155 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-510073a5-a01c-4da7-b44e-c5511cb873f6 req-8e3b3173-2697-4b91-a5f2-591d31d4b380 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.101932 Aug 09 11:49:39.197102 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 620/1235] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:49:39.439998 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:39.440582 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:39.448022 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:39.448436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:39.448867 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:39.449552 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:39.450010 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:39.450455 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:39.590042 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:39.597594 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-a0bfd126-3b33-445c-aed1-09b686f6f4a1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.161542 Aug 09 11:49:39.598150 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 616/1236] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:39 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:40.623831 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:40.624957 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:40.633310 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:40.633811 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:40.634243 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:40.634963 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:40.635459 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:40.635880 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:40.777504 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:40.785523 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-81d6955b-dc3e-4907-a0e5-e31e4f13eeb1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1265 microversion: 2.1 time: 0.169254 Aug 09 11:49:40.786099 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 621/1237] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:40 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:41.809731 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:41.810609 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:41.822020 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:41.822866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:41.823592 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:41.824740 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:41.825441 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:41.826188 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:41.971107 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:41.979417 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b382912b-23dc-4d99-8fe7-2807f8e24446 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1453 microversion: 2.1 time: 0.176209 Aug 09 11:49:41.980023 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 617/1238] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:41 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:42.002369 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:49:42.003087 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:49:42.010280 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:42.010758 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:42.011227 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:42.011922 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:42.012342 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:42.013018 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:42.154662 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:49:42.162844 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-87abedf6-6d50-41d8-ab48-9fb31c399553 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1453 microversion: 2.1 time: 0.166620 Aug 09 11:49:42.163461 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 622/1239] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:49:41 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:49:43.802499 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-997be6a7-4e30-4d5a-bea0-b117bd700b59 req-a6059b69-a7e4-42bc-901e-7ecdc9d088ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "235d907b-d003-4459-958f-83f6c65ed8ef", "tag": "de0c1f5c-0633-4f36-8a23-fd8cda391e8e"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:49:43.814637 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-997be6a7-4e30-4d5a-bea0-b117bd700b59 req-a6059b69-a7e4-42bc-901e-7ecdc9d088ca service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:49:43.815141 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-997be6a7-4e30-4d5a-bea0-b117bd700b59 req-a6059b69-a7e4-42bc-901e-7ecdc9d088ca service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:49:43.815568 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-997be6a7-4e30-4d5a-bea0-b117bd700b59 req-a6059b69-a7e4-42bc-901e-7ecdc9d088ca service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:49:43.827364 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-997be6a7-4e30-4d5a-bea0-b117bd700b59 req-a6059b69-a7e4-42bc-901e-7ecdc9d088ca service nova] Creating event network-changed:de0c1f5c-0633-4f36-8a23-fd8cda391e8e for instance 235d907b-d003-4459-958f-83f6c65ed8ef on hv-cinder-84989 Aug 09 11:49:43.832591 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-997be6a7-4e30-4d5a-bea0-b117bd700b59 req-a6059b69-a7e4-42bc-901e-7ecdc9d088ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034168 Aug 09 11:49:43.833172 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 618/1240] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:51:03.038755 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:51:03.039866 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Tue Aug 9 11:51:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:51:47.052836 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:51:47.053701 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=52 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:51:47.056768 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd57bbce-b6f7-42e3-9cc5-48162058b767] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 09 11:51:47.057966 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_api:SELECT=30 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:51:47.058651 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:47.059130 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG dbcounter [-] [117792] Writing DB stats nova_cell1:SELECT=58 {{(pid=117792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:51:47.059725 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:47.063854 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-80090027-4d56-410a-9ad6-ccebb2ea797a req-2b99100a-208a-4e8e-badd-cc64c1b1e2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "235d907b-d003-4459-958f-83f6c65ed8ef", "tag": "de0c1f5c-0633-4f36-8a23-fd8cda391e8e"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:51:47.066539 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:47.067403 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:47.067529 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:47.068144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:47.068901 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:47.069495 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:47.075765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-80090027-4d56-410a-9ad6-ccebb2ea797a req-2b99100a-208a-4e8e-badd-cc64c1b1e2f5 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:47.076349 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-80090027-4d56-410a-9ad6-ccebb2ea797a req-2b99100a-208a-4e8e-badd-cc64c1b1e2f5 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:47.076837 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-80090027-4d56-410a-9ad6-ccebb2ea797a req-2b99100a-208a-4e8e-badd-cc64c1b1e2f5 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:47.089102 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-80090027-4d56-410a-9ad6-ccebb2ea797a req-2b99100a-208a-4e8e-badd-cc64c1b1e2f5 service nova] Creating event network-changed:de0c1f5c-0633-4f36-8a23-fd8cda391e8e for instance 235d907b-d003-4459-958f-83f6c65ed8ef on hv-cinder-84989 Aug 09 11:51:47.094288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-80090027-4d56-410a-9ad6-ccebb2ea797a req-2b99100a-208a-4e8e-badd-cc64c1b1e2f5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039410 Aug 09 11:51:47.095193 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 619/1241] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:51:47.095721 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:51:47.177311 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f180e469-ea3a-4463-b86e-3c7f4988cde0 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "DELETE /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 204 len: 0 microversion: 2.1 time: 0.126334 Aug 09 11:51:47.177896 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 623/1242] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:51:47 2022] DELETE /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:51:47.186583 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:47.187413 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:47.194084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:47.194631 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:47.195006 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:47.195693 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:47.196133 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:47.196551 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:47.331735 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:51:47.339439 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-1ad3150e-6631-4a1d-8677-f0f78a10a3c8 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1578 microversion: 2.1 time: 0.157040 Aug 09 11:51:47.340098 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 620/1243] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:51:47 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:51:48.363604 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:48.364348 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:48.371458 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:48.371943 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:48.372374 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:48.373075 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:48.373541 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:48.373979 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:48.507399 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:51:48.515895 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1d16463c-d267-4e02-ab4d-deb97281fa3f tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1578 microversion: 2.1 time: 0.157826 Aug 09 11:51:48.519922 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 624/1244] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:51:48 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:51:49.512082 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd57bbce-b6f7-42e3-9cc5-48162058b767] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 53086. Aug 09 11:51:49.538352 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:49.539054 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:49.545537 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:49.546019 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:49.546484 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:49.547224 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:49.547682 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:49.548109 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:49.558038 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-b1830cc8-92b6-45fd-ae24-d0ebedf3d07c req-4f50895d-bc80-48c8-9beb-cd878f7b32b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235d907b-d003-4459-958f-83f6c65ed8ef", "name": "network-vif-deleted", "tag": "de0c1f5c-0633-4f36-8a23-fd8cda391e8e"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:51:49.569089 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b1830cc8-92b6-45fd-ae24-d0ebedf3d07c req-4f50895d-bc80-48c8-9beb-cd878f7b32b6 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:49.569565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b1830cc8-92b6-45fd-ae24-d0ebedf3d07c req-4f50895d-bc80-48c8-9beb-cd878f7b32b6 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:49.569989 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-b1830cc8-92b6-45fd-ae24-d0ebedf3d07c req-4f50895d-bc80-48c8-9beb-cd878f7b32b6 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:49.581494 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-b1830cc8-92b6-45fd-ae24-d0ebedf3d07c req-4f50895d-bc80-48c8-9beb-cd878f7b32b6 service nova] Creating event network-vif-deleted:de0c1f5c-0633-4f36-8a23-fd8cda391e8e for instance 235d907b-d003-4459-958f-83f6c65ed8ef on hv-cinder-84989 Aug 09 11:51:49.586324 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-b1830cc8-92b6-45fd-ae24-d0ebedf3d07c req-4f50895d-bc80-48c8-9beb-cd878f7b32b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088170 Aug 09 11:51:49.587233 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 621/1245] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:51:49.612072 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:51:49.619580 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-11f7c5cf-b5fd-441a-a772-25bc7c5d26dd tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 200 len: 1225 microversion: 2.1 time: 0.086568 Aug 09 11:51:49.620142 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 625/1246] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:51:49 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:51:50.645697 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:50.646918 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 235d907b-d003-4459-958f-83f6c65ed8ef] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:50.657500 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:50.658368 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:50.659168 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:50.660304 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:50.661058 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:50.661801 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:50.679335 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] HTTP exception thrown: Instance 235d907b-d003-4459-958f-83f6c65ed8ef could not be found. Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Request method failure captured: Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef HTTP/1.1 Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kh0t_0eA2DUHHjhx_FHwagKPPV033R1ze_4FZLCs4996MpB4mVqKiotLTwJU12WlnJKRpAfMuxC65FGNS21g2OxLVPx5O8AIFvGfun0WvxTSB_XZIhxbWQ1S77ZzEsrK0zIONqcYDKcIFy5EO6egHffBOdQ6_EVEiqeuyfT44p9Kok Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:51:50.680984 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ef4b4745a37c42c7b0d60bd9c5f8c8fd", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 2e88ebde3f9b4f1fb4269e71152e99f7 Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 235d907b-d003-4459-958f-83f6c65ed8ef could not be found. Aug 09 11:51:50.682729 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '235d907b-d003-4459-958f-83f6c65ed8ef'} Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 235d907b-d003-4459-958f-83f6c65ed8ef could not be found. Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:51:50.683776 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 235d907b-d003-4459-958f-83f6c65ed8ef could not be found. Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 235d907b-d003-4459-958f-83f6c65ed8ef could not be found. Aug 09 11:51:50.685565 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:50.687404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Returning 404 to user: Instance 235d907b-d003-4459-958f-83f6c65ed8ef could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:51:50.687404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-753bcff7-10f4-4394-bac2-cf78e0f941c1 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef" status: 404 len: 111 microversion: 2.1 time: 0.044629 Aug 09 11:51:50.687404 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 622/1247] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:51:50 2022] GET /compute/v2.1/servers/235d907b-d003-4459-958f-83f6c65ed8ef => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:51:54.072542 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:54.073110 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:54.074607 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-faeb98fa-89bb-4a2a-8d88-5c88f09551c4 req-fa424014-9b91-463c-83c1-43c3b4b5b395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f04c4be-4924-44cd-a3ac-72284638563c", "tag": "dd723cd1-6c21-47f3-be40-f48a3b95baec"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:51:54.079803 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:54.080289 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:54.080716 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:54.081406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:54.081850 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:54.082505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:54.086050 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-faeb98fa-89bb-4a2a-8d88-5c88f09551c4 req-fa424014-9b91-463c-83c1-43c3b4b5b395 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:54.086597 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-faeb98fa-89bb-4a2a-8d88-5c88f09551c4 req-fa424014-9b91-463c-83c1-43c3b4b5b395 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:54.087120 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-faeb98fa-89bb-4a2a-8d88-5c88f09551c4 req-fa424014-9b91-463c-83c1-43c3b4b5b395 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:54.098649 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-faeb98fa-89bb-4a2a-8d88-5c88f09551c4 req-fa424014-9b91-463c-83c1-43c3b4b5b395 service nova] Creating event network-changed:dd723cd1-6c21-47f3-be40-f48a3b95baec for instance 5f04c4be-4924-44cd-a3ac-72284638563c on hv-cinder-84989 Aug 09 11:51:54.104288 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-faeb98fa-89bb-4a2a-8d88-5c88f09551c4 req-fa424014-9b91-463c-83c1-43c3b4b5b395 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033563 Aug 09 11:51:54.104884 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 623/1248] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:51:54.109365 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 11:51:54.190212 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c0ccdf33-67fb-4b56-ab9a-bcbd9d722906 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 204 len: 0 microversion: 2.1 time: 0.121820 Aug 09 11:51:54.194144 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 626/1249] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:51:54 2022] DELETE /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 11:51:54.199731 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:54.200765 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:54.207779 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:54.208264 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:54.208698 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:54.209398 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:54.209850 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:54.210267 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:54.354436 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.policy [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117792) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:51:54.362139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-9c4068ea-1112-4a15-af48-4dcbfec73bce tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1577 microversion: 2.1 time: 0.166555 Aug 09 11:51:54.362702 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 624/1250] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:51:54 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 11:51:55.386045 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:55.386962 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:55.396443 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:55.396939 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:55.397405 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:55.398084 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:55.398562 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:55.399025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:55.549688 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:51:55.557840 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e54fbbb9-bad7-4b8e-b210-a84f933bcbcb tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1577 microversion: 2.1 time: 0.178168 Aug 09 11:51:55.558407 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 627/1251] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:51:55 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:51:56.498260 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [req-ea67f59e-7a50-44ec-8d5a-3095d2b1767a req-90c32434-92d4-441e-89ae-b9b5054f3bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f04c4be-4924-44cd-a3ac-72284638563c", "name": "network-vif-deleted", "tag": "dd723cd1-6c21-47f3-be40-f48a3b95baec"}]} {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 11:51:56.508517 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-ea67f59e-7a50-44ec-8d5a-3095d2b1767a req-90c32434-92d4-441e-89ae-b9b5054f3bb0 service nova] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:56.508975 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-ea67f59e-7a50-44ec-8d5a-3095d2b1767a req-90c32434-92d4-441e-89ae-b9b5054f3bb0 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:56.509386 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [req-ea67f59e-7a50-44ec-8d5a-3095d2b1767a req-90c32434-92d4-441e-89ae-b9b5054f3bb0 service nova] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:56.520541 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.compute.server_external_events [req-ea67f59e-7a50-44ec-8d5a-3095d2b1767a req-90c32434-92d4-441e-89ae-b9b5054f3bb0 service nova] Creating event network-vif-deleted:dd723cd1-6c21-47f3-be40-f48a3b95baec for instance 5f04c4be-4924-44cd-a3ac-72284638563c on hv-cinder-84989 Aug 09 11:51:56.525344 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [req-ea67f59e-7a50-44ec-8d5a-3095d2b1767a req-90c32434-92d4-441e-89ae-b9b5054f3bb0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Aug 09 11:51:56.525967 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 625/1252] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 11:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 11:51:56.579642 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:56.580335 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:56.588152 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:56.588907 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:56.589516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:56.590247 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:56.590701 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:56.591147 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:56.702019 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e88ebde3f9b4f1fb4269e71152e99f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4b4745a37c42c7b0d60bd9c5f8c8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 11:51:56.713406 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-21e71161-e398-452f-809f-0571f28337d6 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 200 len: 1225 microversion: 2.1 time: 0.137259 Aug 09 11:51:56.714080 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 628/1253] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:51:56 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 11:51:57.738395 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:57.739247 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: 5f04c4be-4924-44cd-a3ac-72284638563c] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:57.748874 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:57.749489 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:57.750089 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:57.751002 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:57.751456 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:57.751880 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:57.767546 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] HTTP exception thrown: Instance 5f04c4be-4924-44cd-a3ac-72284638563c could not be found. Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Request method failure captured: Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c HTTP/1.1 Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kh0t_0eA2DUHHjhx_FHwagKPPV033R1ze_4FZLCs4996MpB4mVqKiotLTwJU12WlnJKRpAfMuxC65FGNS21g2OxLVPx5O8AIFvGfun0WvxTSB_XZIhxbWQ1S77ZzEsrK0zIONqcYDKcIFy5EO6egHffBOdQ6_EVEiqeuyfT44p9Kok Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:51:57.769160 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ef4b4745a37c42c7b0d60bd9c5f8c8fd", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 2e88ebde3f9b4f1fb4269e71152e99f7 Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance 5f04c4be-4924-44cd-a3ac-72284638563c could not be found. Aug 09 11:51:57.770935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': '5f04c4be-4924-44cd-a3ac-72284638563c'} Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f04c4be-4924-44cd-a3ac-72284638563c could not be found. Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:51:57.771956 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f04c4be-4924-44cd-a3ac-72284638563c could not be found. Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f04c4be-4924-44cd-a3ac-72284638563c could not be found. Aug 09 11:51:57.773608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:57.775139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Returning 404 to user: Instance 5f04c4be-4924-44cd-a3ac-72284638563c could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:51:57.775139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-0e9e2770-ecce-4a08-a9e9-ca2959664aa5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c" status: 404 len: 111 microversion: 2.1 time: 0.039858 Aug 09 11:51:57.775139 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 626/1254] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:51:57 2022] GET /compute/v2.1/servers/5f04c4be-4924-44cd-a3ac-72284638563c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:51:58.210256 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:58.210785 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:58.217512 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:58.217930 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:58.218357 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:58.219074 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:58.219654 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:58.220062 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:58.233040 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] HTTP exception thrown: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Request method failure captured: Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 HTTP/1.1 Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept: application/json Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Connection: close Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Length: 0 Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Content-Type: application/json Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Host: 10.222.0.59 Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.11 Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABi8kh0t_0eA2DUHHjhx_FHwagKPPV033R1ze_4FZLCs4996MpB4mVqKiotLTwJU12WlnJKRpAfMuxC65FGNS21g2OxLVPx5O8AIFvGfun0WvxTSB_XZIhxbWQ1S77ZzEsrK0zIONqcYDKcIFy5EO6egHffBOdQ6_EVEiqeuyfT44p9Kok Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Role: reader,member Aug 09 11:51:58.234675 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ef4b4745a37c42c7b0d60bd9c5f8c8fd", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Id: 2e88ebde3f9b4f1fb4269e71152e99f7 Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: method: > Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: exception: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.236516 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: action_args: {'id': 'a958af07-bc3f-4975-ad4b-4a90d796e273'} Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:51:58.237505 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.239287 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.240988 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Returning 404 to user: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:51:58.240988 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ec9e4a03-9f8c-4418-a3e9-4bfab0dc8129 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 404 len: 111 microversion: 2.1 time: 0.029881 Aug 09 11:51:58.240988 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 629/1255] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 11:51:58 2022] DELETE /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:51:58.246405 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '>' {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:58.247057 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.compute.api [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [instance: a958af07-bc3f-4975-ad4b-4a90d796e273] Fetching instance by UUID {{(pid=117792) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 11:51:58.253383 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:58.253870 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:58.254300 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:58.255041 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Acquiring lock "4705de16-1b33-4787-8512-7dde2b8ef61e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 11:51:58.255493 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 11:51:58.255919 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG oslo_concurrency.lockutils [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Lock "4705de16-1b33-4787-8512-7dde2b8ef61e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 11:51:58.269608 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.wsgi [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] HTTP exception thrown: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Request method failure captured: Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: request: GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 HTTP/1.1 Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept: application/json Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Accept-Encoding: identity Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Connection: close Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Length: 0 Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Content-Type: application/json Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Host: 10.222.0.59 Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Openstack-System-Scope: None Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: User-Agent: python-urllib3/1.26.11 Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Auth-Token: gAAAAABi8kh0t_0eA2DUHHjhx_FHwagKPPV033R1ze_4FZLCs4996MpB4mVqKiotLTwJU12WlnJKRpAfMuxC65FGNS21g2OxLVPx5O8AIFvGfun0WvxTSB_XZIhxbWQ1S77ZzEsrK0zIONqcYDKcIFy5EO6egHffBOdQ6_EVEiqeuyfT44p9Kok Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Id: None Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Domain-Name: None Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Identity-Status: Confirmed Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Is-Admin-Project: True Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Id: default Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Domain-Name: Default Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Project-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Role: reader,member Aug 09 11:51:58.271153 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Roles: reader,member Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ef4b4745a37c42c7b0d60bd9c5f8c8fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ef4b4745a37c42c7b0d60bd9c5f8c8fd", "adminURL": "http://10.222.0.59:8080"}]}] Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Id: ef4b4745a37c42c7b0d60bd9c5f8c8fd Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-Tenant-Name: tempest-TestVolumeBootPattern-338320703 Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Id: default Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Domain-Name: Default Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Id: 2e88ebde3f9b4f1fb4269e71152e99f7 Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: X-User-Name: tempest-TestVolumeBootPattern-338320703-project Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: method: > Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: exception: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.272935 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: action_args: {'id': 'a958af07-bc3f-4975-ad4b-4a90d796e273'} Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: {{(pid=117792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 11:51:58.274084 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. Aug 09 11:51:58.275829 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: ERROR nova.api.openstack.wsgi Aug 09 11:51:58.277312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: DEBUG nova.api.openstack.wsgi [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Returning 404 to user: Instance a958af07-bc3f-4975-ad4b-4a90d796e273 could not be found. {{(pid=117792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 11:51:58.277312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO nova.api.openstack.requestlog [None req-b723fd79-cdab-414d-bfb7-05f2736cc3b5 tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273" status: 404 len: 111 microversion: 2.1 time: 0.030039 Aug 09 11:51:58.277312 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: [pid: 117792|app: 0|req: 627/1256] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 11:51:58 2022] GET /compute/v2.1/servers/a958af07-bc3f-4975-ad4b-4a90d796e273 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 11:51:59.604129 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7cd8a4a7-13f0-4347-bf49-c917f517628b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] Calling method '.version_select at 0x7fece2edd940>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 11:51:59.608633 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7cd8a4a7-13f0-4347-bf49-c917f517628b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [cd2dd3c2-1b78-45cd-8ae1-ddbdc9d67fad] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 11:52:00.619784 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [None req-7cd8a4a7-13f0-4347-bf49-c917f517628b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] [cd2dd3c2-1b78-45cd-8ae1-ddbdc9d67fad] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 53144. Aug 09 11:52:00.644146 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7cd8a4a7-13f0-4347-bf49-c917f517628b tempest-TestVolumeBootPattern-338320703 tempest-TestVolumeBootPattern-338320703-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-575759671" status: 202 len: 0 microversion: 2.1 time: 1.043902 Aug 09 11:52:00.644726 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 630/1257] 10.222.0.59 () {58 vars in 1260 bytes} [Tue Aug 9 11:51:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-575759671 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 11:52:40.226358 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:52:40.227366 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Tue Aug 9 11:52:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:54:22.296997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:54:22.297967 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:54:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:54:23.052400 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:54:23.053313 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Tue Aug 9 11:54:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:54:36.544020 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:54:36.546180 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Tue Aug 9 11:54:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:54:44.836017 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:54:44.836997 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:54:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:56:00.240071 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:56:00.240961 dv-cinder-849890-5-iscsi devstack@n-api.service[117792]: Tue Aug 9 11:56:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:57:04.012181 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:57:04.013025 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 11:57:42.310665 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 11:57:42.311388 dv-cinder-849890-5-iscsi devstack@n-api.service[117793]: Tue Aug 9 11:57:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!